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ABSTRACT 

The second phase of a project designed to further 
analpe the factors contributing to the task difficulty in Naval jobs 
and to determine the optimum training methods for these Jobs is 
reported, A telephone survey of experts attempted to gather data 
regarding task difficulty. The results of the survey were 
inconclusive. As a result of the problems experienced In conducting 
the survevf an overall p].ari was developed to guide subsequent 
investigations in which task difficulty is either controlled or 
manipulated. An experiment was conducted to ascertain whether 
cartoons, the accompanying text, or a combination of the two were 
responsible for the facilitating effect of imagery found in an 

The psults of this experiment failed to validate 
he findings of the earlier one in that no such facilitating effect 
was found. A second experiment was therefore conducted, using paper 

rather than a hardware simulation of the task. The results 
of this experiment also showed no evidence that Imagery improves 
prformance. A third experiment investigated the Influence of 
raining bask fidelity of simulation on transfer performance. The 
data ^rom this study indicated that stimulus and respoiise fidelity 
has little effect on response time or accuracy. 
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TECHNTCAT REPORT; NAVTRADEVCEN 69-C-0253- 1 
LEARNING, RETENTION AND TRANSFER 
IN MILITARY TRAINn^G 



ABSTRACT 



This report summarizes Phase I and reports on Pi.ase II of the L R anrt t 

the factors contrlbutins 

task difficulty in Nayai jobs, and to conduct a further exploration of the 
influence of imagery, fidelity of simulation, and retention interval on le^n- 
ing, retentmn, and transfer. A survey of expert opinion regarding task diffi- 
yeS'^f investigations were conducted during 

The specific purpose of the Task Difficulty Survey was to define those factnrQ 

difficulty in the operational Navy setting 
factors can be used to manipulate realistically the^ 
difficulty _of tasks in laboratory invesAgations. Telephone interviews were 
conducted with 10 scientists, representing both military and civilian research 
organizations, to obtain the required information. " research 

The results of this survey were Inconclusive. Further, a majority of the dlf> 
acuity factors mentioned by interviewees were the same ones which have 
been previously studied in the laboratory. Consequently, the problem be- 
Suggesting an approach for manipulating such vm-iables. An 
P-f® IS suggested to guide subsequent investigations in which task 
difficulty is either controlled oi* manipulated. 

current series were conducted during 

fidelity of sImTaMon Experiment V with 

ExpGrinient III sddr©s8©d two Questions^ 

relative training effectiveness of two forms of 
imagery; i. e. , (a) when new material is related to more 

an analagous fashion and (b) when new 

material is represented directly? 

t^^pVesenUHon onmag^^^^^ " 

Sind?n'’rxp“Hm:nA?rfte^^ 

ight of the subject samples and expermental procedures used. 
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Experiment IV was nimilar to with the exception that subjects were trained 
with a paper and pencil rather than a hardware simulation of the task. The 
purposes of this study were to resolve discrepancies in the results between 
Experiments II and III, and to test the hypothesis that the effectiveness of 
imagery interacts with verbal skills. The findings were consistent with 
Experiment III providing no evidence that Imagery Improves performance. 

This finding was consistent regardless of verbal skill level. The hypothesis 
that imagery should be more effective for subjects with lower verbal skills 
was thus not supported. Those results are discussed in relation to the 
restricted range of verbal skills of the subjects used. 

Experiment V investigated the influence of training task fidelity of simulation 
on transfer performance. Subjects were trained using one of three levels 
of fidelity. The data indicated that variations in stimulus and response 
fidelity had little effect on response time or -'ccuracy. The data are inter- 
preted as supporting the findings of Experimem II; i.e. , that relatively high 
levels of training effectiveness can be obtained for procedural tasks in the 
absence of high physical fidelity between training and transf'r tasks. 

Measures of retention examined after two- and seven-day retention intervals 
(across Experiments I and II, respectively) showed considerable improve- 
ment (approximately 20 to 60 percent) in both the speed and accuracy of 
second- session performance over that of the initial session. However, after 
a 14 -day retention interval (Experiment III) response speed in the second 
session was no better than first-session speed and for the accuracy measure, 
performance in the second session was considerably below (apt>roximately 
30 percent) the first-session level. The Implications of these findings to 
military training are discussed. 

In a final section the v/ork on this program is summarized and recommenda- 
tions are made for the direction of future research. 
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FOREWORD 

Th s report docunients a second vear*s pf’fny'f • a. 

in establishing a program of dovelopment on SaL'ng 

tranofer ^or the purpose of djuprovlnff th^ nnaH+ ntioHj 

logical information Pertinent to the desig^ of mllSary“??aSn^f 

THE FRESENT PROGRAM OF RESEARCH 

Under the two year contract with HoneTwell Tnc i j. 



~ SgMbto?inT^n°" ‘'ft'"®?? gathered and guidelines have been 

■■ effort made by an outstandinff arrav of 

everts in the field, especially for the present pr^fo?^ ^ 

- ’^our general types of tasks (procedure follovdna decision mak-irv, 

iL?i"Sd\s%'L""^sr?jfe 

to be subjected to experiment^ investigation? ® 

oharacteristios of 'p^^c^Iure-mS tlsr^^be?." 

® ^°“r ®^«P“>ental variables. The first yei'a rel^l??h 

and"ftri training variables, viz., "imagery* 

in?efSaU»°ff"tT continued t?^ 

,ptigation of these uwo factors and extended the scoDe of atiidv 

ind“i°di^I S^Ifere^er^"- 

forniatiQn about the nature of operational if v j ? 
^th the other related inforLtTllFrl^^^^^^l^f 
_ ur general categories of Naval tasks) and additional r levant 
infonnatlon that is to be acquired in 4e futiine t^ ^ . 

mental tasks under investigation to real-world Naval jobs.^ 
aspect of research is considered critical to the oblective of 
laborat r" favorable position from which to generalize 

N^v^rSngl^^^^^^^^ application fn real 

THE PROJECTED PROGRAM OF RESEARCH 

1 provlded by the past work on this prograjn future 

thrMgUSs"I?°:h\erfoni:r^ variables, iome of 

TASK VARIABIES. Considered to be g primary importance are the questions 
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of the generaliziability and applicability of findings obtained from research 
on one type of task to various other tasks. These questions should find 
answers through studies on the influence of the same variables on different 
task characteristics. In the conduct of such studies, along with the task 
features already identified under this program (mentioned above), several 
different schemes for characterizing the features of tasks will be examined 
for their ability to distinguish among behavioral effects. 

TRA.MING VARIABLES, Training variables selected for study will be based on 
certain cognitive notions of emerging interest which, emphasize information- 
processing activities of the performer (of which the imagery variable in the 
present research is an example). Individual difference factors will be 
examined where such variables would appear to interact mth variables of 
primary, ^ interest, '^he Influence of temporal parameters (e,g., retention 
intein'-al, duration oi practice, distribution of practice) will continue to 
be e^qjlored across experiments, and only In cases of especial interest will 
such variables be ej^mined within any one experiment, Finfilly, research 
on fidelity of simulation will take into account the different possibl"^ 
meanings of the term discussed within (viz., resemblance of training and 
criterion equipment, resemblance of training and criterion task materials, 
presence or absence in training of tasks to be performed in transfer). 




ARTHUR 3. BLAIRS 
Human Factors Ijaboratoiy 
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SECTION I 

‘ -# 

« 

INTRODUCTION 



BACKGROUND 



i®i ^^P®*** summarizes the results of the second year of work in 
study of learning, retention, and transfer (L, R, and T) apnli cable to 

desi^gn and utiliz^ion of Naval training systems. Duri^ the inmal 

NAVTRADEVr f *° provide assistance to the 

Rv i" * establishment of a long-term in-house rese 

ces available con °ii^' T »'esearch and the limited re 

es avauAble, considerable planning has been required to deUne an 

manageable proportions. 

The formulation of a research plan was accomplis 
following activities (Bernstein and Gonzalez, 1969h 



activ- 
sour- 
of 



result of the 



A brief review of relevant literature 
Selection of an appropriate task taxonomy 

A survey of Navy jobs to determine critical tasks from the 

standpoint of training 

Organization and management of technical meetings v 
consultants - 

A conceptual design for a general-purpose L, R, and 



As development of this plan took the greater portion of the first vear 

only two experimental studies were condulted. xLse studies wTre des^^^^^ 

to try out the newly developed set of program requirements. The secontf 
year s ef^rts emphasized laboratory investigations to provide a data base 

cS^rilutlL^^^^^ “ddition/iralalyslfof feclors 

o4 1 • 11® V difficulty in operational jobs was performed This analv- 

sis logically followed the survey of Naval jobs conducted during Phase 1 ^ 

problem in conducting L, R. and T research is choosing from a 
g list of possible vanahles which can be studied. The selection of ornh- 
lems for study should be based on a prloritv svstem tL of prob 

formulated with an aim toward estawS^pffiTe-s flr"re"sefrc™t^p™" 

which importance is the taxonomic category of the skill for 

citegories”varifs’wlth“th^''t ° =°«ected. The number of possible behavioral 
categories varies with the taxonomy used. Part of the planning phase involved 



o 
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(1961) was 

Th?h^n'T®t and Peterson define tasks at three^levels of specif“ftv 

The broadest level contains three categories At th^ i 

three are broken down to a list of six. Suftask/beha^ol V 

given in the level III list. exeen tasK/ behavior uategories are 



P®t®i-.son's descriptions and examples of level 
tasks tor initial^r performed to select high-priority 

investigafions on?h?» of^p^r^o- 

procXrans"tIsk.'’"Se,^ce ^eSet *°in “h “ 

electronms equipment. Op^ral^rof t^fs^equfp^^^^^ Sres°suW^cist“*""^ 

tron™t"a^i"'’&'i;r P”"-Pl--' -d proc2du^r?;?n^^ymhltfc c'ommuSi^ 

racy. Based on araraTyVil S^srs^r 

tharpr''ocedufe-7on^>4°4^®® reflected a minimum of skill components other 



eriment I 



the e’SL^mintaft^sWnfe *° establish baseline data on 

this experiment were n^^dedToVtreMfo^^^^^^ 

• The identification of methodological problems. 

• Determination of acquisition and transfer performance func- 

'+ xpenment I was designed to compare performance 

Experiment! also allowed 
blocks of problems to be equated in difficulty. 



• Information was needed about how subjects organized infor- 
mation necessary, to performing the t^k. dSI^ Extent 

uW^d to verbal reports were taken with the data 

used to make final improvements in the instruction manual. 

in an effort ^tn improve for forming imagery sequences, 
more detail discussed in 
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Time and accuracy scores during acquisition conformed to the classical 
negatively accelerated monotonic function, characteristic of more traditional 
learning experiments. Improvement over problem blocks was associated more 
with time than with accuracy scores. Moreover, the correlation between the 
two measures was not statistically significant, suggesting independence be- 
tween measures. These data were interpreted as evidence that subiects 

tended to work slowly until they became more confident of the correct oroce- 
dures. ^ 



An absence of significant differences between performance on the two sets 

was found. Thus, two equivalent problem sets were available for use with 

Woodworth and Schlosberg's (1954) Plan 3 or Plan 5 for transfer of trainine 

experiments. - 



An examina,tion of subjects post-experimental verbal reports directed at- 
tention to a familiar psychological principle. Several subjects stressed the 
need to understand basic functional relationships in the system. These sub- 
jjCts indicated that the use of correct procedures was easy if one fully under- 
stood the nature of the communications network. It was interesting that the 
subjects who volunteered this information performed at generally higher 
l'"vels than did the other subjects. ® 



Another interesting finding was the c imparison between performance 
during the first and second sessions. This investigation showed no evidence 
of forgetting over the 24 -hour retention interval between sessions. The 
absence of a retention loss on this task contrasts strongly with the findings of 
more typical memory experiments using verbal materials. The difference 
may be associated with the meaningful organization of verbal associations 
found in the present tas^k. Such organization tends to be absent in rote list 
learning tasks, unless it is Imposed mnemonically by the subject. When such 
a mnemonic system is used in list learmng, forgetting is drastically reduced 
(e.g. , Senter and Hauder, 1968). 

An appeal to inherent organization in the to-be- learned material of this 
procedural task is consistent with the earlier discussion of subjects' verbal 
reports. That is, subjects were unlikely to forget the nature of the system 
in one day. Thus, they could use their understanding of functional system 
relationships as pegs for recalling specific details of operation. 



Two variables were selected for initial investigation in Experiment II, 
and to a further extent, during the second year of the program. The decision 
to study imagery and fidelity of simulation was primarily based on discussions 
held at the L, R, and T Technical Meetings,''* 



*The subject matter of these meetings is provided in Appendix B of the Phase 
I final report (Bernstein and Gonzalez, 1969). 
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Fidelity of Simulation -- This term refers to the similarity between a training 
device and its operational counterpart. Similarity can vary both in terms of 
the stimuli and the responses involved in equipment operation. Thus, fidelity 
of simulation can be viewed within a transfer of training paradigm. 

The designers of training devices tend to assume that training effective- 
ness varies as a function of the degree co which the trainer physically simu- 
' lates the operational equipment. This assumption is consistent with the 

classical model of transfer (Osgood, 1949) to the extent that positive transfer 
is highest when both the stimmli and responses of two tasks are maximally 
similar. 

One may question, however, the applicability of Osgood's model to the 
design of even moderately complex training systems. Two major differences 
exist between Naval tasks and the kinds of tasks used to test the Osgood para- 
digm. First, the typical transfer of training experiment Involves a simple 
relationship between the stimuli and responses of the acquisition and transfer 
tasks. Second, as was mentioned earlier, laboratory learning tasks tend to 
differ fundamentally from real-world tasks in forms of inherent organization. 

To illustrate both points, let us consider a typical transfer experime.i. 
The majority of transfer investigations have been conducted using a paired- 
associate (PA) task. The reason for this is that easily identifiable stimulus 
and response terms are present in a PA list. Maximum positive transfer is 
obtained when subjects are trained to provide the correct response term (RT) 
for each stimulus term (ST), and the same list is carried over to the transfer 
situation. Maximum negative transfer takes place when both the ST's and 
RT's are carried over, but the associations are re* onstructed on a random 
basis. In the latter situation, the subject must both i nlearn the original asso- 
ciations and acquire the new ones. Merely carryi^y over the ST's and 
replacing the RT's with an entirely new set typically fails to produce negative 
transfer, and often actually results in a small amount of positive transfer 
(Battig, 1966). According to Battig's (1968) analysis of the specific compo- 
nents of learning in a PA task, it is not surprising that positive transfer is 
obtained in this last situation. That is, many components of learning are 
carried over from acquisition to transfer. 

The difficulty in analyzing even rather simple equipment operating tasks 
into a list of PA's is evident. Operational procedural tasks usually involve 
sequential dependencies not present in an orthodox PA list. The task used in 
the present program has a logical structure with responses contingent on 
stimuli and other responses. 



*See Appendix D of the Phase I report (Bernstein and Gonzalez, 1969), 

14 
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The presejice of a logical structure in this procedural task produces an 

f ^ complemty factor associated with the 

branching of contingpt responses. However, the fact that the contingencies 
^ ave an inherent logical ba^is tends to simplify operation. This point relates 
to the e^arlier discussion about Experiment I, where we point out impor- 
tance of learning functional system relationships, compared with rote learning 
of procedures. Without a well formulated mnemonic system, the subieci In a 

choice but to learn by a rote method. This discussion 
leads to the hypothesis that transfer, in a realistic procedural task, does not 
critically depend on relationships between specific stimuli and specific 
responses. Rather, it depends more on the extent to which knowledge of sys- 
tem structure and functional relationships applies to the operational task. If 
system does^ an effective job of teaching underlying system struc- 
fhf^lity^^^”^^^ he able to tolerate relatively low levels of physical 

(1968) suggests that transfer can be achieved through mediated 

that man can generalize and discriminate among 
different situation^ by abstracting critical features from those situations and 
by generating verbal descriptors. These verbal descriptors then mediate the 
physical response. One would thus hypothesize that even if the stimuli and 
responses^ of the task were physically different, but the trainee was able to 
abstract the critical elements, transfer would remain at a high level. 

Experiment II was designed in part as a prelimlnarv test of +bi« • 

One group of subjects received training on the operatio^l equioment.^^^ 
second group was trained on a paper and pencil representation of the equip- 
menO ■^e front ^nel drawing was highly accurate, but was rendered^in 

white. Color coding was used to denote priority information in the 
actual device, while priority data in the low fidelity trainer was conveyed by 
letter design^ions. Both groups received 30 acquisition problems using 
either the high or low fidelity device. 

The primary difference between the two fidelity conditions was in the way 

Low fidelity subjects could not actually operate controls, 

but instead, wrote in their responses on an answer sheet. For example, 
ins ead of turning a rotary switch, the subject wrote the number of the switch 
proper"swlt^lr^^^ pushing switches, the subject made a check mark over the 

* ^ one-week retention interval, all subjects received a second 

Operational equipment. Low-fidelity sublects 
exhibited significantly longer response times on the first set of transfer 
problems, but thereafter did not differ from the high-fidelity group. The 
two groups were equivalent, throughout, in terms of accuracy, 

fi«Hi results were consistpt with the experimental hypothesis and the 

M Grimsley, 1989; Mahler and Bennet, 

1950, Newton, 1959; Wilcomn, Davy and Webster, 1954); l.e., relatively low 

1 $ 
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produced satisfactory training effectiveness. 
While each of the other studies involved actual military tasks, containing an 

uncontrolled combination of skill components, the present study concerned 
itself solely with procedural learning and transfer. 



Imagery -- Imagery, as related to retention, denotes the use of visual mental 
representations ot relatively concrete objects as mediators for storage. The 
term has recently been used in connection with mnemonic systems for 
improving memory. Mnemonists are able to recall very long lists of unrelated 
items on a one-trial learning basis. They accomplish this by associating the 
to-be-learned items, with a previously overlearned set of word pegs, each 
having a basic logical relationship with every otheb one (Yates, 196S). The 
association of the hew items with the pegs is thought to be enhanced by the 
creation of usually bizarre images of a relationship. 



Recently psyciiologists have Investigated the use of imagery under con- 
trolled laboratory conditions. Senter and Hauder (1968) found that subjects 
who were trained to use the above-described mnemonic system exhibited 
markedly superior acquisition and retention performance over a control group 
which was not given imagery training. 



Palvio and his colleagues have conducted a number of experiments on the 
ima|e-arousing potential (I) of word pegs (e.g, , Paivlo, 1963; Paivlo, Yuille, 
and Madigarij 1968; Paivlo^ Yuille and Smythe^ 1966), Collectivelyj these 
experiments provide convincing evidence that !_ is an important determinant of 
speed of acquisition when subjects are instructed to use imagery. Moreover, 
I acts in much the same way as meaningfulness, but relates more to the con- 
creteness of the word pegs. 



The post-experimental verbal reports of subjects from Experiment I com- 
bined with the concept of imagery suggested an experimental technique for 
improving training effectiveness. The idea was to provide subjects with a 
more concrete means of acquiring and retaining knowledge of system struc- 
ture. The technique was based on the fact that Imagery involves two principal 
features: 1) a set of very familiar items acting as pegs for the mediation of 
me new material, and 2) highly vivid visual representations of a relationship 
between the pegs and the to-be-acquired items. 



The present application of imagery differed from the usual mnemonic 
methods because the material to be learned was not simply a list of items. 
Rather, the aim was to present a clear description of how the communication 
system was structured. We reasoned that such information could be made 
more salient if an analogy could be drawn between this system and a system 
with which subjects had basic familiarity. 

Subjects in the imagery group were given a five-minute presentation of 
cartoon slides showing situations occurring in the course of commercial air 
travel which were analogous to each of the communication routines. The text 

IB 
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of the commentary accompanying each slide was contained in the manual anH 

read verbatum to the subjects. Control group subjects were ffiven the tiTnp* 

used for imagery presentation (5 minutes) to study the manuaf. * 

- A 4 ^*’^ imagery group exhibited superior response times in the acauisitinn 
and transfer sessions. The time saved by imagery subjects averaged about 
25 percent. Imagery produced no significant diffei-e is in either lession 
when performance was measured in terms of percent accuracy. 



m 

i?- 



Phase I Conclusions 

concl^lonsr^*^^ experiments suggested the following four 

• Modifications to training methods, based upon feedback from 
trainees, can increase training effectiveness. 

• Providing subjects with fi idamental knowledge of basic sys- 
tem structure and their rnle within that structure seems to 

pri;Tc?pl\s”anTprocSe^^ 

o?St7m”s?ructuref^"^“® technique for providing knowledge 

• Apparently, training effectiveness is not reduced by low-fidelltv 

training on the procedural ta?k used In the experiments. ‘ 

STATEMEP^^T OF THE PROBLEM 

f Phase II of the L, H, and T program was concerned with: (1) an analysis 
of factors which contribute to task difficulty in Naval jobs, and 2 a further 
examination of imagery and fidelity of simulation. This one-year effort 

experiments and a survey of expert opinion regarding task 
_ifficulty. L, R, and T Experiments in and IV dealt with imagery and 
Experiment V with fidelity of simulation. * magery, and 



Identification of Task Difficulty Factors 

^°'^®^^tent mth the pragmatic approach adopted during the first year of 
this progrp, efforts have been made to select research tipfis -^1h marimum 
relevance to operational training problems. Although the earlier survey of 

^What is now c^led Experiment IV was actually the fifth experiment chrono- 

hgically, but because it involved the study of imagery it is nresented 
directly after Experiment III. ^ ^^lagery, it is presented 

O } ' ■' 
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Navy jobs produced a list of high-priority tasks, the survey did not identify 
factors influencing the difficulty of performing these tasks. 

The specific purpose of the Task Difficulty Survey was to define those 
factors which influence task difficulty in the operational setting. Once defined, 
these factors can be used to manipulate task difficulty in the laboratory setting. 
This approach to the selection and use of variables for laboratory studies 
stresses maximum relevance and transferability of laboratory findings to the 
solution of real-world problems. 



L, R, and T Experiment III 

The purpose of this investigation was to explore further the role played 
by imagery in the acquisition and transfer of procedural skills. Experiment II 
suggested that the principle of imagery has considerable potential to enhance 
procedural learning; i.e. , learning is facilitated when subjects can relate to- 
be-learned material to previously familiar information through visualization. 
In the earlier study, the familiar material acting as a peg was the commercial 
air-travel system. Subjects who were shown cartoons depicting this system 
and were told how various travel situations were similar to analogous com- 
munication procedures operated the synthetic communication device more 
rapidly than did an appropriate control group. This application contained both 
fundamental ingredients of the imagery principle, viz. , the relations between 
unlearned and overlearned information and the provision of visual images. 
Although both ingredients seem to be necessary in the more traditional use of 
imagery as a mnemonic device in verbal learning, one may question their 
criticality in a procedural skills context. 

The purpose of Experiment III was to provide information on this issue. 

More specifically, two questions were addressed by the present investigation, 
viz: 



• What is the relative training effectiveness of two forms of 
imagery; i.e., (1) when new material is related to some 
familiar material in an analogous fashion, and (2) when new 
material is represented directly. 

• What are the relative contributions of images and text in the 
presentation of imagery? 

Experiment III was designed to ascertain whether the cartoons, the 
accompan 3 nng text, or a combination of the two were responsible for the 
facilitating effect of imagery found in Experiment II. Moreover, a direct 
comparison was made betvreen imagery directly related to the communication 
system, and imagery describing an analogous situation. The comparison tests 
the value of pegs, which historically have been overlearned material. This is 
in contrast to providing word pictures of the to-be-learned material, which 
may themselves mediate the element of learning. 
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L» R, and T Experiment IV 

or A?**® ‘he L, R, and T communication device 

or trmmng opei-ators of Naval systems in actual procedural tasks reauirer 

relatively large amounts of verbal instruction. Even moderately comnlex 
procedural tasks involve a host of contingent actions. The presLSn of 

these contingencies and the correct responses for each, result in manv 
pages of te^ or lengthy direct discburse. One would thus buspect that a ^ 
trainee^s ability to acquire such information would be heavily Influenced by 
his '^erbal skills. In other words, a trainer ability to follow instruckons is 
limited by his ability to understand the disc arse as it is presented 

It was mentioned earlier that imagery may be effectiye because it tends 
to increase the concreteness of the to -be -acquired material. Thus, it would 
se^^m that the imagery would be particularly effective for trainees who have 
difficulty comprehending verbally presented instructions. 



The purpose of Experiment IV was to test the hypothesis that there is an 
interaction between verbal skill level and the effectiveness of imager- Sunh 
an experiment requires measurement of this skill and the blocking of subiec's 
according to their test scores. j - 



???* common tests of Intelligence contain subtests for verbal skills 
Verbal intelligence correlates highly with academic achievement: a learninff’ 
exnerience which requires comprehension based on verbally presented ® 
maieraal. A case can thus be made for assuming that acquisition rate on a 
procedimal skills task, similar to that of the present experiment, would corre- 
late w^h verbal intelligence. This reasoning led to the use of a verbal IQ 

bl^sis Test (Ammons and Ammons, 1962) was selected as a 

4 .U ^ r blocking verbal abilities, ihis test was chosen primarily because nf 

which it can be administered and the fact that it corLlates 
highly with more traditional verbal abilities tests. t.orreiates 



L, R, and T Experiment V 

The major difference between high and low fidelity of simulation in 
Experiment II was in the way subjects responded to communication problems. 
The low-fidelity condition involved a rather accurate stimulus simulation of 
^ absence of degradation in training effectiveness 

with the low fidelity training conditions suggests that practicing the identical 
physical response is not critical to the transfer of procedural skills. 

The next logical question involves similarity of the equipment used in the 
traimng and transfer situations. One might ask how much difference in 
appearance subjects can tolerate between training equipment and operational 
hardware. 
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tested experimentally In the present investigations. 
However, the changes in stimulus conditions were made with a very funda- 

functional relationships in the com- 
munications systems always remained constant from training to transfer. 



nnr,Ai?^f of variation are analogous to situations in which the front 

cau^tf desi^ llnlf 

obsolete ? equipment, based on older operational equipmentf to become 

Hnr, Wittrock's (1968) concept of mediated generalization, a oredic- 

u ^ made in Experiment II seems to be iustlfied 

j rninant of transfer* it may not be neces^arv’ fi^T* 

_o operate the equipment when learning. That is* it may be sufficient for 

one’^a^H^J verbalize what responses they would^ak,i if they were 

of subiects^*S®Xe'S^i*‘tb^'’'® was tested by comparing two groups 

rLponsfs ttev wouw e^Pf omental group told the experimenter what 

p es they would make and the control group wrote in their responses. 
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SECTION II 

TECHNICAL APPROACH - A SURVEY TO IDENTIFY FACTORS 

INFLUENCING TASK DIFFICULTY ^ 



METHOD 



Honeywell originally proposed to obtain task difficulty information bv 

visiting and mtervlewlng personnel in the field. Because^of the anlicipat^ 
scope of such an effort, NAVTRADEVCEN suffeested that this 

the^oneratioifarM individuals who have previously conducted studte^ in 
the operational environment. Therefore, it was agreed that Honeywell would 

conduct a telephone survey of selected scientists to gather the reauired infor 
mation, if possible, without visiting operational systems. quired infor- 

Th© persons contacted during this survey werej 



H. Ammerman - HumRRO, Ft, Bliss, Texas 
G. Briggs - Ohio State University, Columbus, Ohio 
G. Jeantheau - Dunlap and Assoc. , Darien, Conn. 

R. Mackie - Human Factors Research, Santa Barbara, Calif. 

T. Mara - General Dynamics, Electric Boat Div. , New London, Conn. 
W. Matheny - Life Sciences Inc, , Ft. Worth, Texas 
E. Miller - HumRRO, Ft, Bliss, Texas 
L. Schrenk - Honeywell Resear jh, St, Paul, Minn. 

A. Siegel - Applied Psychological Services, Wayne, Pa. 

E. Yaeger - Honeywell Marine Systems Center, West Covina, Calif. 



'The discussion of task difficulty centered on each of the interviewee’s 
responses to the following two questlonsi 



1 ) 



Do you feel it is of value to visit the operational settine 

Obtain information about task difficulty? 



to 



2) On the basis of your experience (i. e. . familiarity with 

military jobs and experimental investigations), what factors 

do you feel influence task difficulty in the operational setting? 

The analysis of interviewee responses involved: (1) determination 
sLnffn * - R- contributing to task difficultyi (2 ) identificatTon of ILse 
specific taaks which respondents felt to be highly difficult,* and (3) identifi- 
cation of the major factors producing difficulty for these specific tasks 



/ 
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PROBLEMS ENCOUNTERED 

Two major problemsi restrict the usefulness of Information obtained. 

First, the interviewees responded in idiosyncratic terms to describe task 
difficulty factors,. The different interviev/ees used different terminology to 
describe similar factors, for example, the "number of different things to be 
done may mean the same as "system load/ overload". However, without 
operational definitions for these terms, it was impossible to state nnequivocaliy 
what was meant. -a ./ 

A second problem concerned the experimental backgrounds of interviewees. 
Although each person contacted is a recognised human factors specialist, the 
background experience of each of these men has by no means covered all tasks. 
Opinions regardLig task dilficulty were, therefore, based on different types of 
observed behavior. This again limits the extent to which the views of one in- 
terviewee can be compared with another. 



RESULTS AND DISCUSSION 

Without exception, interviewees responded affirmatively to Question No. 1. 
Several respondents cautioned, however, that visits to the operational setting 
must be preceded by adequate preparation, i. e. , complete system familiarity 
and well formulated hypotheses. Concern was also expressed about the ability 
of observers to establish and maintain good rapport with operational personnel. 
This factor is considered critical if meaningful data is to be gathered. The 
consensus was that conduct of effective field investigations tends to be more 
of an art than a science, since rigorous control procedures seldom are pos- 
sible to implement. Lack of control is based on the fact that this type of study 
must be conducted, for the most part, on a noninterference basis. One must 
therefore accept data under varying sets of circumstances. 

To place responses to Question No. 2 in clearer perspective, a matrix of re- 
sponses was developed (Table 1). This table summarizes the factors sug- 
gested by interviewees as producing task difficulty. The Individual interviewee 
responses are elaborated in Appendix A. An examination of the appendix indi- 
cates the degree of arbitrariness that was necessary in developing this table; 
it is apparent that other categories could have been used. In addition to the 
lack of agreement between investigators. Table 1 and Appendix A indicate that 
the majority of the factors mentioned are those which have been frequently 
studied in the laboratory. If a competent experimental psychologist would be 
asked to list task difficulty factora, it is likely that the list would include task 
organization, complexity, ambiguity, memory, etc. Therefore, based on this 
small sample, going to the operational environment to catalog variables which 
affect task difficulty appears to be inefficient. 

22 



12 



NAVTRADEVCEN 69-C-0253-1 



Table 1. Factors Suggested to Influence Task Difficulty 
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• Perforniance criteria 

• Operater characteristics 

• Task complexity 

• Training characteristics 
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These task difficulty factors identified above can all be subsumed under the 
variable of task complexity. Difficulty, however, is considerably broader than 
this, and varies, regardless of task, as a function of the following variables: 

9 Performance criteria 

9 Operator characteristics 

# Task complexity 

• Training characteristics 

It is felt therefore, that difficulty is relative, in that no task is difficult 
in and of itself. By way of example, Folley and Munge - (1961) have shown that 
performance can be dramatically influenced by varying the "degree of proce- 
duralization of a task. That is, within a single task there can be varying 
levels of difficulty in performance. 

There is a problem of definition and scaling which relates to all of the 
above difficulty factors. Typically, operational definitions and unique 
measurement schemes have been prepared each time a task difficulty variable 
^ study. Obviously one can continue to define terms and measures 
o it each specific investigation. However, due to their lack of generalize 
ability, such procedures do not provide a workable solution to offr problem. 

The most desirable solution involves the development and validation of 
general difficulty factor definitions and measures. (Despite the fact that much 
study han been devoted to the area of psychometrics , much remains to be 
done. ) Moreover, we consider this to be a task which is far beyond the scope 
and resources of the present contract. 

In general, task performance can be improved by any of the followins 
procedures: ^ ^ s 

© Reducing the criteria for satisfactory performance 

9 Improving the selection procedures, thereby increasing the 
input skill level 

9 Reducing t sk complexity by redesign or incorporation of 
performance aids 

9 Improving the effectiveness of training techniques or in- 
creasing the length of training. 

Further, levels for each of these factors can be defined thus establishing 
a range of performance comparable to tiiat which could be expected under 

Considerably more information is still required 
about the effective levels and possible interactions among these factors. 

translatable research can be accomplished if the experimental 
situation IS carefully patterned after the operational environment 

24 
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RECOMMENDED APPROACH 



The experimental approach which we propose for implementation is 
based on the notion that task difficulty should not be treated as a unitary 
independent y^i^le. Ratter the term should be used as an interveniL 
variaole and studied as it is affected by the manipulation of performance 
criteria, operator characteristics, task complexity, and type of training. 



The primary advantage of this approach is that laboratory resea ch data 
can be applied to the design of training for Naval jobs by experimentally mani- 
pulating factors which directly bear upon successful performance. That is, 
tradeoffs can be identified to weigh training variables against each of the other 
three factors. For example, the performance of a particular task, by a cer- 
tain class of personnel, has been shown to be unacceptable, regardless of the 
quality of instruction. It would make little sense to continually strive to 
develop new training procedures when personnel seL ction or task design is 
the limiting factor in job performance. Laboratory data can provide esti- 
mates of performance at various combinations of levels of each of the four 
factors which influence task dlfficu*cy. 



Implementation of this approach requires the development of an overall 
study pl^ for investigating task difficulty. This study plan must Identiftr 

levels of the four major variables for each experiment. Specification 
of these levels should be aided by knoMedge of the operational setting. That 
isi criteria, task complexity, personnel selection, and training procedures 
can be modeled after those used in the Navy. _In so doing it should be possible 
to establish a basis of comparison for evaluating experimental procedures 
associated with each factor. 



Although the approach proposed here is seen as having a number of 
distinct advantages, it Is not considered to be a panacea. Perhaps the maior 

approach is the development of a theoretical and systematic 

difficulty. Of course, this approach 

to task difficulty requires additional time and resources to manipulate the 
arger immber of yariables systsmatically. However, the proposed systems 

approach should have fewer undesirable influences on the overall program than 

rikl r establishing operational definitions and unique measure- 

ments for difficulty factors each time a study is conducted. 




15 

o 

ERLC 



NAVTEADEVCEN 69-C-0253-1 



CONCLUSIONS 

1) The current survey failed to provide desired information con- 
cerning factors which influenca task difficulty . 

2) The specific difficulty factors mentioned by mtervie%vees did 
not differ significantly from those which might be considered 
if a researcher were to simply make a list of such factors. 

3) There is a lack of generalizable definitions and measurement 
schemes for the various factors which influence task difficulty, 
i, e, , task complexity, performance criteria, operator skill 
level, and training methods. 



26 
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SECTION III 

TECHNICAL APPROACH - EXPERIMENT III 



METHOD 

Apparatus 



The experimental task In Experiment III required the subject to operate 
a synthetic communication system. Two units of equipment constituted the 
apparatus; the subject’s console (Figure 1) and the experimenter’s console 
(Figure 2), Figure 3 shows the complete laboratory facility. 



Equipment operated by the subject included a panel of Indicators and 
switches (commumcatlons control console) and an information display. The 
communiptions control console (CCC). located directly in front of the seated 
^bject, housed all displays and controls necessary for operating the system. 
The information display, which contained all the facts, principles, and pro- 
cedures was a Kodak random -access carousel slide projector and a 5 x 7- 
inch back-illuminated Polacote screen. Subjects accessed 35 mm slides with 
a plector located at the bottom left of the CCC. An index slide provided 
information about the location of all other slides. 



The experimenter’s control panel was connected electrically to the CCC 
The experimenter’s unit served two functions- It permitted selection of the 
communications problems to the subject, and it provided to the experimenter 
i^ormation concerning the subjects' responses. A Hunter timer, positioned 
at the left of the experimenter's panel, was used to record the lapsed time to 
0. 1 second, from the presentation of a problem until its completion. 



The CCC was arranged in three sections. At the left of the panel were 
three displays (lEE readouts) which presented input information. One display 
showedjhe designating number of the initiator of the communication (sender): 
sender’s number was the receiver’s number. At the bottom left of 
.ae C^C was a readout which contained the priority of the requested trans- 
mission. 



central part of the CCC contained 18 microswitch trans -illuminated 
pushbuttons. The top three swltchllghts were used to select a frequehcy for 
commumcation between the sender and the CCC. Below the frequency selec- 
tors was a 3 X 5 matrix of switchlights which served the following functions: 



o 
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Figure 2. Experimenter*s Console 




Figure 



3. Lj R, and T Console 

29 ' 
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® They indicated which channels were in use and the priority 
of the message of that channel. Message priority was Indi- 
cated by the color of the illuminated mdicator.' 

# They were used to select a channel for transmission of 
messages to receivers. 

The output section was located at the right side of the CCC. Two 32- 
position rotary switches, called ''patching dials", were used to select the 
number of the sender and the receiver for each commrani cation. Three 
microswitch switchllghts were used for; (1) cormecting the sender and 
receiver, (2) transmitting standby signals, and (3) transmitting busy signals. 
A momentary pushbutton, at the bottom right of the panel ("transmit signal" 
switch), stopped the timer, and thereby signalled the end of a subroutine. 

Two sets of 30 problems were used. These sets were designed to be 
equivalent in terms of the principles and procedures used. They differed, 
however, in specific ways; i.e„ , in terms of the particular subscribers 
involved and the priorities of messages occupying communication channels. 
Within each set of 30 problems, 13 categories eristed. These categories 
are listed in Table 2, 

The problem sets were divided into five subsets, each containing six 
problems. Problems involved either one, two, or three subroutines. Each 
subset of problems totaled 12 subroutines. A Wollensak monaural tape 
recorder was used to provide Instructions to the subjects, (See Bernstein 
and Gonzalez, 1969, for detailed instructions to subjects. These general 
instructions were the same for all gi’oups and for all the experiments re- 
ported, ) 

Subjects 

Ten male subjects ranging in age from 18 to 25 were used in the experi- 
ment. These volunteers were undergraduate students from the University of 
Minnesota and Hamline University, Subjects were paid on the basis of their 
performance on the task. Pay ranged from $2. 50 to $4.00 per hour. In the 

same manner as the earlier L, R, and T experiments (Bernstein and 
Gonzalez, 1969). 



Procedure 

The subject's task was to arrange for the transmission of messages from 
one system subscriber (sender) to another (receiver). To provide better 
understanding of this task, a task analysis was performed (Bernstein and 
Gonzalez, 1969) for each of the operational sequences. The task analysis 




*Note: Each swltchlight was divided into four sections. Priority one mes- 
sages were shown by the top two sections illuminated red, priority two was 
signalled by green in the lowe^ left section, and priority three was a white 
indication in the lower right section. 
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Table 2, Types of Problems Used in L, R, and T 
Experiments I - V. 



Problem Type 


Number Presented 


Subscriber to subscriber (S-S) 


4 


SubBcriber to terminal to subscriber 


3 


(S-T- S) due to language disparity 




S-T-S -- due to frequency disparity 


3 


S-T-S -- due to frequency and language 


2 


S-T-S rather than interrupt 


2 


Interrupt (STBY)/SS 


2 


Interrupt (BUSY)/SS 


2 


Interrupt (STBY/ S-T-S {language) 


2 


Interrupt (BUSY) /S-T-S (language) 


2 


Interrupt (STBY) /S-T-S (frequency) 


2 


Interrupt (BUSY) /S-T-S ifreqiiency) 

\ 


2 


Deny request (STBY) 


2 


Deny request (BUSY) \ 


2 


Total 


30 



served as the basis for specifying the steps involved In ideal operation of the 
system and was helpful in organising the Instruction manual used during 
training. This manual was virtually identical to that used in Phase I. 

Modes of Oper ation ■■ Although there were 13 categories \pf problems, only 
the following four basic modes of operation existed: 

• Subscriber to subscriber (S-S) 

• Subscriber to terminal to subscriber (S-T-S) 

• Interrupt routine ' \ 

% 

• Deny sender's request to communicate \ 
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The selection of the appropriate routine was dependent on subscriber 

requested transmfJsion'^^ (l^gUage and operating frequency), priority of the 
requested transmission, and availability of channels. Each of the 25 sub- 

scrlbers could transmit or receive on one, two, or three frequencies i e 

<HF), very high frequency (VHP), and ultra high frequency’ ’ 
subscriber was also associated with one of five languages- ^ 
English, German, Greek, Spanish or Swedish. Language and frequency 

characteristics -were provided on the 35 mm slides and could be selected for 

presentation on the inforniatlon display. 

All communications were conducted using either the S-S or S-T-S mode® 

eX?t\rs%"’or but always in conjunction ivith 

. STS mode. Some problems involved a request under con“ 

precluded the use of either the S-S or S-T-S modes. In these 
cases, the sender's request to communicate had to be denied. 

^°^® ■■ When the sender and receiver used the same frequencies and 
ft! I language, and a channel was available on their common frequency, 

cedure TOs'^used-^ communication the following pro- 



(1) Select sender's number on the left "patching dial" 

(2) Select receiver's number on the right -'patching dial" 

(3) Select the uppermost unoccupied channel on the least occupied 
common frequency 



(4) Activate the "connect" switch 

(5) Activate the "transmit signal" switch 



S Mode -- The S-T-S routine was used under any of the following 

hnd'nwf®' t ® ® disparity existed, (b) sender and receiver 

the ^ Operating frequencies, or (c) there was an open channel within 

a sender's. The S-T-S routine was com 

pleted in two discrete pares. The first part included the following steps- 



(1) Select sender's number on the left "patching dial" 

(2) Select position 1 (terminal address) on the .right '‘patching dial" 

(3) Select a frequency within the sender's capability 

(4) Activate the "connect" switch 

(5) Activate the "transmit signal" switch 



After completion of this subroutine, the message had been transmitt»^d 

*he CCC to the receiver, the 

following subroutine was employed* ■ 

32 
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(1) Select position 1 on the left "patching dial" ’ 

(2) Select the receiver's number on the right "patching dial" 

(3) Select the uppermost open channel within the least- occupied 
frequency usable by the receiver 



(4) Activate the "connect" switch 

(5) Activate the "transmit signal" svdtch 

Interrupt Routine --The intGrrupt routine was used when all usable chan- 
ne s were occupied, and the requested transmission was of a higher prioritv 
than one or more of the messages occupying usable channels. In theL cases 
the subject^ signaled the subscribers, using the to-be-interrupted cLnn^ thm 

communication. If the interrupted channel cXi^ed f 

priority-two message, a standby signal was giver, indicating that the inter- 

gi>en°a bu^y IiVnarindlotf' priority-three transmission was 

iZTs constftuttte \nSpf r^^^^ 



(1) Select position 30 on both "patching dials" 

(2) Select the channel to be intGrrupted 

(3) Activate standby" or "busy" for priority-two or priority 

three transmissions, respectively .r 

(4) Activate the "transmit" switch 



(5) Wait for the channel to be cleared 
the Illuminated channel indicator) 



cated by the offset of 



the interrupt routine was always used in coniunction 
mth either the S-S or S-T-S routine. If the transmission was S-S the chan 
nel was interrupted first and the S-S routine followed. However, when i 
ruption was used with S-T-S, it occurred after the receipt of the messaee 
the terminal and prior to the relay of the message to the receiver. 



Deny Sender's Request t o Communicate — When all channels within the 
receiver s rrequency capability were occupied with equal or higher priority 

messages than that currently requested for transmission, the request had to 
be demed. Requests were denied in the foUcwlng way '•^quesi naa to 



(1) Select position 1 on the left "patching dial 



M 



(2) Select eender's number on the right "patching dial" 
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(3) Select any frequency usable by the sender 

(4) Activate "standby*' switch for priority one and tv/o requests and 
the busy switch for priority three requests 

(5) Activate the "transmit signal" switch 

^gt Sessions^ -- Subjects were given approximately one and one-half hours of 
training. The training session Included the following phases- 

(1) A tape recording of the manual was played to the subject. 

(2) ^e experimenter presented five example problems to the sub- 
ject and aided him, to the extent necessary, ir: the completion 
of the problems. The problems consisted of one each of the 
following types- S-S, S-T-S, S-S/Interrupt, S- T-S/Interrupt 
and deny sender's request. 

(3) A 10 -minute free study period was given. 

(4) Thirty training problems wer administered, with knowledge 
of resists (KR) given after each problem. The KR was com- 
plete, i.e. , any and all mistakes were pointed out and correc' 
tions were provided. 

A trial (one problem) consisted of the following steps: 

(1) The experimenter programmed the CCC. 

(2) The experimenter said "ready" , 

(3) The CCC was illuminated by the experimenter, s, atom atic ally 
starting the timer. 

(4) The subject attempted to solve the problem. Each subroutine 
was timed separately. At the completion of o;\e subroutine of 
a problem containing two or three steps, the timer stopped. 

The experimenter then noted the time and switched the console 
off, and then on again, restarting the tim.er. The subiect then 
began the next step. 

(5) KR was administered at the end of each problem. 

y^ 4 . days after training, subjects returned for a transfer session. 

Ak. the start of the second session, the subjects were informed that they woiild 
receive another set of 30 problems similar to those they had worked the 
previous day. No KR was given after these problems. 
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Half the subjects were given problem set A in training and problem set B 
at transfer, and the other subjects were given the two sets in reverse order. 
The order of subsets was counterbalanced across lubjects. For example, 
subject 1 was given subsets In the order l-2~3"4-5; subject 2 received order 
2-3-4-5-1, etc. The order of the problems within subsets was randomized. 

Experimental Design -- Table 3 shows the experimental design for this inves- 
tigation. Five treatment groups were formed on the basis of the type of 
imagery used during training. Eight subjects were assigned to each group on 
a random basis. Sets A and B consisted of 30 problems each which were 
developed in Experiment I. Prior to training on the appropriate problem set, 
each group recermd 5 minutes of preliminary training as indicated in Table 3 
In addition to 40 minutes of general instruction which was the same for all 
five groups. 



Table 3. Experimental Design - L, R and T Experiment HI 



Group 


Training 
Problem Set 


Transfer 
Problem Set 


Subject 

Number 


I. Analogy Imagery 


A 


r ® 


J 1^4 


Plus Text 


B 


A 


5-8 


II. Direct Imagery 


A 


B 


9-12 


Plus Text 


B 


A 


13 - 16 


III. Direct Imagery 


A 


B 


17 - 20 




B 


A 


21 - 24 


IV, Direct Text 


A 


B 


25 - 28 




B 


. A 


29 - 32 


V , Control - No Imagery 


A 


B 


33 - 36 


No Text - Instruction 
Manual 


B 


A 


37 - 40 



Imagery Conditions -- The five imagery conditions used in this experiment 
are described as follows: 

• Analogy imagery plus text -- This group received the cartoon 
slides which depicted the air-lravel analogy from Experiment 
n (see Bernstein and Gonzalez, 1969). The slides were changed 
in that the balloons showing what the characters were saying, 
were taken out. This was done so that the effects of images and 
text would not be confounded. All text was contained in the script 
which was played to subjects from the tape recorder. 

® Direct imagery plus text -- The direct imagery, like the 
analo^^, was presented on 35 mm slides. However, rather 
than showing an analogous system, the direct conditions 
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showed cartoon representations of subscribers interacting 
with the CCC. Again, each of the four basic communloation 
routines was represented. These slides are shown in 
Appendix B. 

• Direct imagery -- These subjects were shown the direct 
imagery slides, but were not provided with the text describing 
each slide. 

® Direct text -- Subjects in this group heard the text but were 
not shown the accompanying slides. Instead, subjects were 
told to form mental pictures of what they were hearing. 

• Control -- Control group subjects were not given any imagery. 
The time normally used for imagery presentation was used by 
subjects to study the manual. 



Two measures of performance (i.e, response time and accuracy) were taken 
during the training and transfer sessions. 

Response Time -- This measure referred to the elapsed time between the 
beginning and completion of a subroutine. Il a subroutine was omitted, an 
elapsed time of 60 seconds was given. 

Accuracy -- Accuracy data are expressed as percentages of subroutines cor- 
rectly processed. The percentages were calculated according to a standard 
scoring method which deducted points from each subroutine for procedural, 
errors. The more serious the error, the greater the scoring penalty. A 
maximum of five points was awarded for each subroutine. For example, an 
unnecessarily interrupted channel resulted in a 3 -point penalty. . If the problem 
could have been accomplished by using a single S-S communication, involving 
only one subroutine, the subject* s score for that problem would have been 
(5-3) 

— ^ — or 40 percent. If, however, the problem required two subroutines, the 
subject* s score would have been or 70 percent, Likewise, a three-stop 

problem in which one three point error was made would have resulted in a 
score of ^ ^ ^ ~ ^ ^ or 80 percent. 



The training and transfer performance curves for each of the five groups 
are shown in Figures 4 and 5. In general, the differences among treatment 
groups in time (Figure 5) and accuracy (Figure 4) were rather small. 



Scoring 



RESULTS 
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TRAINING PROSLEM BLOCKS TRANSFER 

^ A ANALOGY IMAGERY 

DIRECT TEXT 

O O DIRECT IMAGERY 

DIRECT IMAaEPY PLUS TEXT 
NO IMAGERY 



Figure 4. Percent Accuracy for Acquisition and Transfer Sessions 




0—0 DIRECT TEJO’ 

□ O DIRECT IMAGERY 

• DIRECT IMAGERY PLUS TEXT 
X X NO IMAGERY 

Figure 5. Mean Response Time for Acquisition and Transfer 
Session 
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EXP II — & ANALOGY IMAGERY 

)* K NO IMAGERY 

BtP Ml A ^ ANALOGY AND DIRECT IMAGERY 

^ ^ NO IMAGERY 

Figure 6. Mean Response Time for- Acquisition and 

Transfer Sessions of Experiments II and III 
(Retention intervals for Experiments II and 
III were 7 and 14 days, respectively. ) 



Table 4. Analysis of Variance Summary - Response 
Times During Training Session 



Source of Variation 


df 


MS 


F 


Imagery (U) 


4 


245.1 


<1 


Trial blocks (T) 


4 


1836. 8 




(I) 


35 


37^’. 4 


_ _ _ 


I X T 


16 


18.0 


< 1 


T X S 


140 


26.4 





**p <0.01 
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The overall response time performanne of the itnagery groups In this 
expe^riment are comparable to the analogy group of Experiment II (see Fia- 
ime 6). However, there is a notable difference in the response times for 

ttie control groups of the two experiments. The No Imagery {Contr'dI) group of 
Experiment ll performed substantially slower than the control group of ^ 

_ xperiment III. A t^tast was run on the total response times durinff traininp of 
these groups sjnd was found to be statistically significant (t » 4. 2\ p < o. 01): 

Analys^es of variance (ANOVA* s) (Tables € mough 7) were performed on the 

^ - - i ttt nni—... ? ^ -■* - ^ tiizie and accuracy scores for 

xpei iment IH. The various imagery conditions failed to produce a sianificant 

main effect in either session for either measure. The trial blocks efflct was 
statistically reliable, showing a learning effect for both time and accuracy in 
both training and transfe.y sessions. A significant interaction was obtained 
hetween imagery and trial blocks for accuracy scores during transfer This 
IS shown by the non-parallel functions over trial blocks for the different experi- 
mental groups, ^ 



DISCUSSION AND CONCLUSIONS 

The data of this study failed to support the imagery findings of Experi- 
ment n. The absence of an imagery effect seems to be associated with thp 
higher performance of the control group (i.e. , high fidelity - no imagery) of 
Experiment m relative to the control group of Experiment n. Had the no- 
imagery subjects of the previous investigation performed as well as the no- 
im^ery subjects here, we would not have obtained a significant imagery effect 
m the earlier study. 

The most obvious question posed by these results relates to the difference 
in performance of the cont.rol groups of two experiments . The likelihood that 
sampling error was responsible for the difference is very small (o < 0 01) 



A more likely possibility is that differences in procedure accounted for the 
results. Such differences included the following; 



1) In Eiqperiment II, the Instructions were read to the subiects 
by the experimenter. In Experiment HI, the instructions 
were presented on audio tape. 



2) Because more imagery slides were used in the direct condi- 
tions, an additional two minutes of free study was used in the 

Experiment III (seven minutes versus five minutes in Experi- 
ment II) , 







29 



NAVTRADEVCEN 69-C-0253-1 



Table 5. Analysis of ■Variance Summary - Rer •)onse 
Times JDuring Transfer Session 



i . - -Ik -1.- J lUiij'i 

Source of Variation 


df 


MS 


F 


Imagery (I) 


4 


217.6 


1.0 


Trial blocks (T) 


4 


1318.2 


54.0** 


S' (I) 


J5 


213.2 




I X T 


16 


12, 7 


<1 


T X S (I) 


140 


24.4 





< 0 . 01 



Table 6. Analysis of Variance Summary - Response 
Accuracy During Training Session 



Source of Variation 


df 


MS 




Imagery (I) 


4 


68, 7 


<1 


Trial blocks (T) 


4 


502, 8 


12. 1** 


S (1) 


35 


167.2 




I X T 


16 


43.3 


1,0 


T X S (I) 


140 


41,3 





< 0.01 



f 

\ 

I 

t 

i 

i 

r 



1 



l ' 



I 




Table 7, Analysis of Variance Summary - Response 
Accuracy During Transfer Session 



Source of Variation 


df 


MS 


- — 1 

F 


Imagery (I) 


4 


428 


1.4 


Trial blocks (T) 


4 


145.7 


2.9* 


S (I) 


35 


302.6 




I X T 


16* 


88.1 


1, a* 


T X S' (I) 


140 


49. 5 





^^p<0.05 40 
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3) Training effectiveness may have increased because of the 
accumulated experience gained through conducting similar 
experiments by the experisiienters in the present study In 
particular, with more experience, the experimenter could ' 
better respond to subjects' ques^nons. 

4) Although irrelevant to the control group’s performance, there 
was a change in the presentation of analogy images. The 
balloons used in Experiment II, containing messages by the 
figures in the cartoons, were removed for Experiment III. 

This was necessary to make the analogy cartoons equivalent 
to those used for the direct conditions. This change may have 
depressed performance for the analogy group In the present 
Investigation. 

Of these differences, it -^vould seem that the most likely possibility Is that 
the training procedure may have improved enough by the time this experiment 
was run to account for the reduced response time scores of the control group. 
Purther, it may be that If training procedures are siifficlently effective 
imagery adds little to performance. 
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SECTION IV 

TECHSriCAL APPROACH - EXPERIMENT IV 



METHOD 

Appar atus 

The subject’s task was similar to the previous studies. However, this 
investigation was conducted with the paper and pencil eimulation of the equip- 
ment used in Experiment TI (Benisteln and Gonzalez, 1969), 



SubjectB 

Thirty male volunteer subjects from Introductory Psychology classes at 
Hamline University took part in the experiment. Subjects were paid on the 
same basis as in previous studies. Subjects were assigned to treatment con- 
ditions at random. 



Procedure 



Experimental subjects served one at a time. Before participating in the 
experiment, each subject was administered the Ammons Quick Test CQT) of 
verbal skills. In this test, the subject looks at a card containing four scenes. 
The experimenter reads a list of words, and as each word is presented, the 
subject identifies the scene which best illustrates the word. Each of the chree 
cards has associated lists of 50 words, ranging progressively from very easy’* 
to "very difficult". Subjects are scored on the basis of total words correct. 

For each subject, the test took 10 - 15 minutes to administer and about a min- 
ute to score. 



Subjects scoring above the mean for college students (QT scores of 125 
were average) were placed in the high verbal skills group, and those scoring 
below 125 were placed in the low verbal skili group. Of the eight subjects who 
scored exactly 125, four were arbitrarily assigned to the high and four to the 
low verbal skills group. 



Subjects in each group were assigned randomly to one of the three imagery 
groups I analog, direct, or control (no imagery). 

The experimental session began immediately after each subject was assigned 
to an imagery group. 

42 
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Conduct of the experimental session was essentially the same as in the 
previous low-fidelity (paper and pencil) experiments, except that there was 
no trEmsfer session. Half of the subjects in each group were tested with 
problem set A and half were tested with problem set B, as in the previous 
experiments. 



RESULTS 

The performance curves for Experiment IV are shown in Fiffures 7 
through lOo 

Figure 7 shows the response time data for high and low verbal skills 
groups. Figure 8 shows performance response time measures for the three 
levels of imagery, 1. e. , analogy, direct, and control (no Imagery), 

Figures 9 and 10 show the accuracy score data in percent correct for 
high and low verbal skills and for the three imagery conditions. 

Analyses of variance (ANOVA's) were performed for both response time 
and accuracy data. Summaries of these analyses are presented in Tables 8 
and 9, ^ Neither the verbal skill levels nor the imagery conditions produced a 
statistically significant main effect. The trial blocks effect was again statis- 
tically significant (P < 0. 01) for both the response time and accuracy data. 



DISCUSSION AND CONCLUSIONS 

This investigation was conducted for two reasons* (1) To help resolve the 
discrepancy in results between Experiments II and III, and (2) to test the 
hypothesis that the effectiveness of imagery interacts with verbal skills. 

The findings of the current study are consistent with that of Experi- 
ment in, showing no evidence that Imagery improves performance as the 
operation of the synthetic communication system. This was true regardless 
of the verbal skill level of subjects, as measured by the Ammons QT in this 

experiment. It should be pointed out that the imagery conditions in Experi- 
ments ni and IV and that of Experiment H were different in that the verbal 
balloons 'were removed in Experiments IH and IV. 

Once again, the control group of the present experiment outperformed 
its counterpart of Experiment II. The hypothesis that overall training effec- 
tiveness had improved after Experiment II seems to be further supported by 
these data. It appears that subjects were able to comprehend the functional 
relationships existing among elements in the .system without the presentation 
of either the direct or analogous imagery. 
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50-1 




TRIAL BLOCKS 



Figure 7. Mean Time o Complete Subroutines 
(Verbal Skill Groups) 
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Figure 8. 



Mean Time to Complete Subroutines 
(Imagery Levels) 
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Figiffe S. Mean Percent Accuracy 
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Figure 10. Percent Accuracy 
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Table 8. Analysis of Variance Summary - Hesponae Time 
During Training 



Source of Variati i 


df 


MS 


P 


Verbal skill (V) 


1 


399. 8 


1. 25 


Imagery (I) 


2 


136. 5 


<1 


Trial .Blocks (T) 


4 


1264. 8 


33. 7 8*^ 


V X I 


2 


29. 7 


<1 


V X T 


4 


28. 5 


<1 


I X T 


8 


17. a 


<1 


S (VI) 


24 


319.6 




V X I X T 


8 


36. 7 


<1 


T X S (VI) 


96 


37.4 


1 



P<0. 01 



Table 9. Analysis of Variance Summary - Response Acctiracy 
During Training 



Source of Variation 


df 


MS 


r~F 


Verbal skill (V) 


1 


14,6 


<1 


Imagery (I) 


2 


135. 2 


1. 50 


Trial Blocks (T) 


4 


242. 1 


6. 99** 1 


V X I 


2 


37. 1 


<1 


V X T 


4 


17. 0 


<1 


I X T 


8 


57. 8 


1. 67 


s cri) 


24 


90. 0 




V X I X T 


8 


25. 0 


<1 


T X S (VI) 


96 


.34, 6 





m P<0. 01 
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The hypothesis that imagery should be more effective for subiects with 
lower verbal skills was not supported by these data. There was no etridenc 
that high versus low scorers on the Ammons QT were different in their 
fu to^learn to operate the communication system. Stated differently 

Ammons test failed co predict performance on the criterion task. 

The absence of predictive validity for this test may be the result of an 
excessively restricted range in verbal skills for the subjects used This 
statement is supported by the fact that over half of the subjects (16) scored 
at the mean for college students or within two points of the mean. 

The present investigation does not appear to provide conclusive res’ilts 
regarding the effects of imageyyr^on subjects of varying verbal skills U may 
be worthwhile to run another group of subjects who score significantiy lower 
than the coUegB students used in this study. The subjects of this experiment 
could then be considered high snorers and the new group, low scorers. The 
additional group should then be subdivided according to Imagery condition in 
a manner similar to that used with the subjects already run. 

If an Interaction could be demonstrated between imagery and verbal skill 
R would help resolve the discrepancy in findings between Experiment II and 
Experiment III and IV. That is, the difference in performance associated 
with imagery in acperlment II, may have been the result of less than adequate 
instruction. Because the training was so depenaent on verbal instruction the 
have been effective when the verbal presentation was sub- 
optimal. A second approach to this problem may be used. An experiment 
in which quality of instruction is treated factorlally with imagery may also 
explain the mcc nsistency of the obtained findings. ' . ^ 

However, these two suggested approaches are closely related. Instruc- 
tpns may be effective for people of relatively high verbal skill and ineffec- 
tive for lower skilled subjects. Further research certainly seems Indicated 
relating to verbal skills, quality of instruction, and imagery. 
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SECTION V 
& 

TECHNICAL APPROACH - .EXPERIMENT V 



METHOD 

Apparatus 



Training equipment for this «+udy was of the paper and pencil type. Three 
versions of the training equlpmeiiL vere used (Figures 11 through 13). These 
versions varied systematically in ^erms of their similarity to the operational 
hardware. The highest fidelity representation (Figure 11) was identical to 
that used in Experiments/ II and IV. The medium fidelity drawing (Figure 12) 
differed from the operational equipment in that the front panel components 
vere reo. iented by a 90-degree shift. The lowest fidelity drawing (Figure 13) 
contained a 90-degree shift plus a change in all controls and displays. 
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INPUT REQUEST 

SENDER RECEIVER PRIORITY 





Figure 12. Medium- Fidelity Panel 
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Subjects 

Forty- eight male students from the University of Minnesota and Hamline 
University took part in the experiment. Subjects were assigned to the six 
treatment conditions at random. The subjects were again paid from $2. 50 to 
$4. 00 per hour for their participation. 

Procedure 

The procedure for this study was the same as that used previously, 
except that all subjects were ti'ained with a paper and pencil representation of 
the equipment. 

Again, one set of problems was used for training and the other for trans- 
fer. Differences in fidelity occurred during training, with all subjects trans- 
ferring to the actual equipment. The transfer session was conducted 14 days 
after training. 

Experimental Design 

Table 10 shows the design for tliis study. Six groups of subjects wore 
used in a 2 x 3 factorial arrangeni ent. Two levuls of response fidelity nigh 



Tal "'e 10. Experimental Design - L, II and T - Experiment V 



Training 




— ) 
t 

f 


Stimulus Fidelity 


j Response Fidelity 


T I’arisrer 


Subject 

Number 




\'erba' 


l^roblem Set A 


1 - 4 






Problem Set B 


5 - 8 


Low 


Written 


Problem Set A 


n 12 






Prolilem Sc't B 


1 3 - 10 




\erhn 1 


Problem Set A 


17 - 2 0 






Problem Set B 


21 - 24 


Medium 


Written 


Problem Ret A 


2 5 - 2 8 






Problem Set B 


29 - 32 




Verbal 


Problem Set A 


33 - 3G 






Problem Ret B 


37 - 40 


High 


Written 


Problem Set A 


41 - 44 






Problem Set B 


15 - 48 
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{wi^iiten) and low (verbal)^ and tiiree levels of stimulus fidelity (high, medium 

and low similarity) were usedl. Eight subjects were assigned to each treat- 
ment group. i. t 



RESULTS 



The response time data (Figures 14 and 15) suggest that variations in 
stimulus and response fidelity had little effect on t-aining effectiveness 
Response times during transfer show an effect simJar to that obtained in 
Experiment II; i. e. , a marked increase in speed from the first to th S'-'C 
block of problems. 

The accuracy data (Figures 16 and 17) also show little effect of levels 
of stimulus and response fidelity. Performance curves during transfer for 
written versus verbal groups, are very )\early identical. Subjects who were 
trained under the lowest stimulus fidelitj^ condition were somewhat less ac- 
curate at transfer than were medium and high- stimulus fidelity groups (Fig- 
ure Id), - ■ ^ ^ ® 

Apparently, accuracy performance suffered a greater loss at transfer 
innn did response time. Although subiects quicklv rc^gainc'd their speed 

accuruc;) consisteiitly rumained oclow firsd session levels. 

Analyses of variance were performed on the time and accuracy scores froir 
aoiausition and iramsicr sessions. These ANOKA'S are summarized in Tables 
IL uirough 14. Neither method of responding nor stimulus fidelity produced 
signiiicant mam effects. Only one interaction wa.s four.d to be significant 
(p 0. 05), viz. , stimulus fidelity x trials i i percent accuracy during train- 
ing; no interpretation for this finding is available at present. 



DISCUSSION AND CONCLUSIONS 

The results of this investigation extend the findings of Experiment II. Con- 
sidered togeiher with the other research in the area, we now have considerable 
evidence iliat relativcTy high levels of training efr(,*ctiveness for procedure 
tasks Ctifi uc* ni jintuiiied in tile absence of high physical fidelity between training 
and tr insfer tasks. This appears to be true both' in terms of the stimulus and 
response components cd’ the task. 



These findings lend support to Wittrock's (op. cit. ) concept of mediated 
generalization as the basis of transfer in procedural skills. Apparently 
s ibjects can cope with variations in the stimulus and response components of 
the task as long as the basic system structure and functions remain unchanged 



The written response is considered to be of higher fidelity than the verbal 
response because the former requires hand-equipment relationships which 

those involved in operating the actual equipmer whereas 
su^ch hand-equipment relationships are absent with the verbal response 
Ihese definitions, however, are arbitrary and unique to this situation. 
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Figure 14. Mean Response Time as a Function of Stimulus 
Fidelity 
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Figure 15. Mean Response Time as a Function of Response 
Fidelity 



ERLC 



43 



PERCENT ACCU RAC‘. PERCENT ACCURACY 



NAVTRADEVCEN 'o9-C-0253-l 




IVIEDIUM o o 

HIGH □— o 



B igure 16, Accuracy as a Function of Stiinulus Fidelity 
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Table 11. Analysis Variance Summary - 
Response ne During Training 



Source of Variation 


[ df 


MS 


F 


Response method (E) 


1 


729. 4 


< 1 


Stimulus Fidelity (F) 


2 


847. 5 


< 1 


Trials (T) 


4 


4958. 8 


99. 


R X F 


2 


jOI. 5 


< 1 


R X T 


4 


59. 8 


1. 37 


F X T 


8 


31. 1 


< 1 


S (R X F) 


42 


92 1 . 9 




R (R X F X T) 


8 


42. 0 


< 1 


T X S (R X F) 


168 


49. fi 





p < 0. 01 



Table 12, Analysis of Variance Suminary - Arcsin Transformed 



Percent Accuracy Scores During Training 



Source of Variation 


df 


1 MS 

J a 


F 


Response method (R) 


V" 

1 


0. 1337 


< 1 


Stimulus Fidelity (]•’) 


2 


0. 2235 


1.51 f) 


Trials (T) 


4 


0. 6271 


21. 56-- 


R X F 


2 


0. 3182 


2.0 6 


R X T 


4 


O' 

o 


1 . 80 


F X T 


8 


0.0007 


2 . 0 8- 


S (R X F) 


42 


0. 1541 




R (F X T) 


8 


0. 0399 


1.37 


T X S (R X F) 


168 


0. 0201 





- p < 0. 05 



NAVTRADEVCEN 69 -C- 02 53-1 



Table 13. Analysis of Variance Summary - 
Response Time During Transfer 



Source of Variation 


df 


MS 


F 


Response method (R) 


1 


2. 6 


< 1 


Stimulus Fidelity (F) 


9 


56. 7 


< 1 


Trials (T) 


4 


7983. 4 


54. 37=:«:' 


R X F 


2 


24. 7 


< 1 


R X T 


4 


171. 5 


1. 54 


F X T 


8 


84. 5 


< 1 


S (R X F) 


42 


903, 6 




R X F X T 


8 


102. 1 


1 


T X S (R F) 

1 


168 ! 


146. 9 


i 



p < 0. 0 1 



Table 14. Anal> s's of Variance Summary - Arcsin Transformed 
Percent, Accuracy Scores During Trensfer 



Source of Variation 


df 

^ 


MS 


F 


Pespense method (R) 


1 


1 0. 0003 


< 1 


Stimulus Fidelity (]-’) 


2 


0. 4345 


< 1 


Trials (T) 


4 


0.2482 


10. 85"”- 


R X F 


2 


0. 1109 


< 1 


R X T 


4 


0. 0091 


< 1 


V X T 


8 


0. 0216 


< 1 


S (R X F) 


42 


0. 4840 




R X F X T 

( 


8 


0. 0107 


< 1 


T X S (R X r) 1 

i 


168 


0. 0229 





p < 0. 01 



i 

i’ 

r- 

r 



f- 




46 



NAVTRADEVCEN 39-C-0253-1 



It is worth noting, however, that subjects’ performance on early trials 
of the transfer task reflects cliaiiges to the equipment and different methods 
of responding. Subjects require more time to process communication rou- 
tines on these initial trials. However, response times improved very rapidlv 
by til© second block of trials* As was mentioned in the discussion of the 
Phase I results, unless initial performance is critical, high physical fidelity 
does not appear to be a stringent requirement. ^ 

The discrepancy between time and accuracy measures, in terms of trans- 
fer performance, was an interesting finding. The accuracy data obtained in 
this experiment tended to be poorer than that obtained earlier. This was 
not the case for response time. Accuracy at transfer was not reduced in 
xpei iment III to the extent that it was in the present investigation sugo'est- 
ing that the two-week retention interval was not solely responsible Onlhe 
othe^r hand, accuracy scores did not differ significantly as a function of 
fidelity conditions. Moreover, this discrepancy was not apparent in Experi- 
ment II. Thus, it does not seem likely that low-fidelity training is the pri- 
mary repon for the lower accuracy scores. Possibly, a combination of a 
two-week retention interval and training with paper and pencil simulations 
produced the obtained effect. 



Also, it should be kept in mind that knowledge of results was not provided 
during transfer trials. Therefore, an initial drop in accuracy would tend to 
perseverate throughout the transfer session. An experiment appears to be 
needed m which feedback is treated as an independent variable during trans- 
ter, with training provided under high- and low -fidelity conditions. 



Integrative Review of Imagery and Fidelity of Simulation 



An effort is made in this section to consider the fidclityand imagery 
characteristics of the present experiments in relation to other research in 
the area. Although the literature review contained in this section might 
typically be presented in the introduction, this section contains frequent 



2 

That this effect is influenced by the transfer to the actual equipment from 
paper and pencil training is suggested by a similar result obtained in a 
Pha^se I experiment (Experiment II). That study showed a decrement in 
per ormance at the start of transfer and rapid subsequent improvement for 
a ^oup trained with paper and pencil, while subjects trained on the actual 
equipment showed considerably less initial loss. Thus, since the initial 
transfer eifect was due to paper and pencil training In this previous experi- 
ment, it seems reasonable to assume that the similar effects in the pre- 
sent experiment were also a result of pencil and paper training (although 
a control group trained on the actual equipment is not available for com - 

present case). An implication of this assumption is that 
the difference between training on the actual equipment and training with 
paper and pencil has a greater effect on initial transfer than differences 
in either the configuration of the controls and displays or variations in 
the response mode employed. (This point is Indicated by the close cluster- 
ing of all ourvss at all stages of transfer in Figures 14 and 15, ) 
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references to aspects of tae experiments, which suggests that it be more 
appropriately presented .ere, 

lins.gery -- The imagery variable manipulated in the pr’esent studies repre- 
sented a calculated gamble; namely, the attempt to extend recent thinking on 
the role of imagery (I) in verbal learning to the specialized use of pictures 
in an instructional situation. I.aboratory research on imagery has concen- 
trated on development of objective quantitative measure of I (e. g. , Paivio, 
i'uille, and Madigan, 1968) and on the functional status of I in studies of 
adults' and children's ver bal learning. Scholarly reviews of this research 
are not wanting, and include summary articles by Palvio (1969, 1970), Reese 
(1970), Rohwer (1970), and Bower (in press). The context of such efforts 
has been primarily that of "list learning" in its various forms (i. e. , PA 
learning, serial list learning, free recall, recognition, and memory span 
techniques). Such studies obviously emphasize the S's retrieval of specific 
information, scored in terms of discrete words on word groupings, rather 
than the S’s ability to perform conceptual and procedural tasks. Though the 
emphasis on "discrete" words in such laboratory tasks should not be confused 
with a lack of concern for conceptiml and relational principles, it is true that 
the task of the present experiments departs considerably from the typical 
list learning laboratory test. Likewise, the psychological scaling of single 
words for properties of I, concreteness-absta’actness, and meaningfulness 
finds no ready application to the Instructional methods evaluated in the pre- 
sent research. 



These distinctions between laboratory "list learning" and laboratory- 
instructional investigations regarding the role of imagery In verbal learning 
need not pose an insurmountable obstacle to future efforts to take advantage 
of knowledge concerning imagery processes in Instructional or training pro- 
grams. Rather, the available iiterature suggests a number of clues (albeit 
by hindsight) for the subsequent design of such research, and these leads are 
discussed briefly below. 

According to Paivio (e. g. , Paivio and Yarmey, 1966) verbal stimuli may 
arouse sensory images which will mediate response recall (i. e. , the con- 
ceptual-peg hypothesis). Accordingly, Paivio (1969) has shown that mean- 
ingfulness and imagery have separable effects, with that of I on the processing 
of the stimulus term in PA learning. Meaningfulness has its greatest effect 
on the response term. Future work on procedural- instructional programs 
mTght thus concentrate efforts on developing vivid word instructions and 
pictorial representations of stimulus or cue-function material, with less 
emphasis on Imagery for the procedural response component. 

Picture s versus Words -- The attempt to facilitate performance through 
pictorial representations of key concepts during the Instruction session may 
^6 ti’&ced to it ^laboratory based antecedents fairly directly. According to 
Paivio (1869), "Objects or their pictorial representations arouse non-verbal 
images directly and, to the extent that such images facilitate the formation 
of associative connections with response members, pictures should be even 
more effective than concrete nouns, at least as stimulus members" (p. 254). 
Studies conducted prior to 1966 had examined the effect of pictures versus 
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words on the stimulus or re«ponse side in PA learning, though Paivio and 
Yarmey (1966) were the first to investigate words versus pictures in all 
possible combinations (S-R) in a 2 x 2 factorial design. Consistent with the 
'''onceptual-peg hypothesis, Paivio and Yarmey found PA learning with pic- 
torial stimuli as cue terms to be superior to verbal stimulus eonditions. 

Most of the picture-versus-word research has been performed with PA 
tasks, though some Imagery research on this topic has also been done with 
free recall (FR) and serial learning procedures. And, In FR, a number of 
studies (Lieberman and Culpepper, 1965, Paivio, Rogers, and Smythe, 1968) 
have shown higher levels of recall for familiar objects than for the word 
names of the objects. 

Paivio (1970) has recently reviewed a series of studies comparing pic- 
torial and sentence (verbal context) depicting of pair relations. This work 
is a step closer to the present efforts. In his review, Paivio suggests that 
both imagery and verbal symbolic processes are operative in S's learning of 
pair relations (citing only Milgram, 1967, with a negative finding on imagery). 
Davidson and Adams (undated) studied children's learning of associations 
between pictorial representations of objects, and found learning aided by pre- 
sentation of the objects in relation to one another (e. g. , a rope around the 
neck of a jar) compared to simple juxtaposition of the objects (e. g. , rope 
and jar side-by-side). In a rented study directly concerned with Imaginal 
processing, Rower (in press) investigated associative learning of paired 
words representing objects. One group was instructed "to imagine the two 
objects" (represented by words) "one at a time separated in their imaginal 
space, like two pictures being seen on the opi)osite walls of a room". The 
other group was instructed to imagine scenes in which the two objects inter- 
acted (in a manner similar to that explicitly used by Davidson and Adams). 

In cued recall, the "interactive" group recalled 71 percent of the responses 
that were to have been associated with the cues, while the "separate" imagery 
condition recalled far fewer items (46 percent). 

Such experiments provide obvious leads for future vmrk on aiding instruc- 
tional routines with either pictorial representations or deliberate imaginal 
procedures. For example, the Ss in the present study were not explicitly 
instructed to process the pictorial aids in any particular way, or to relate 
the events within any single cartoon one to another. Yet, recent laboratory 
efforts of the sort described above suggest that development of associative 
relations between cue and response words or objects is very much a function 
of the interactive processing which may occur, rather than just a simple 
consequence of using pictures themselves. In this context, facilitation of 
retention results not itself from imagery, but from "integrated" imagery of 
the sort mentioned above. That is, the integration is achieved by the setting 
of to-be-learned materials in certain specific contexts (e. g. , pictures of 
related objects, sentences relating key words, etc. ), or directing S to pro- 
cess the materials himself in like fashion. Thus, Rohwer (1966) and Paivio 
(1969) find associative learning of pairs of common nouns to be facilitated 
by an intervening verb or preposition, but not aided by an intervening con- 
junction, The latter presumably does no more to establish an Integrative 
imagery or verbal context efft. jt than merely listing the terms separately. 
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Is this last factor one possible (though unintended) characteristic of the use of 
pictures to benefit verbal instruction in the present experiments, and hence a 
contributing element to the generally null imagery results here obtained? 
Although an exact answer is impossible as yet, the possibility of an affirma- 
tive answer is strong enough for the integrative hypothesis to receive more 
atcerition in future investigations. 

Several investigations have been performed to compare potentially dif- 
ferential cue properties of words and pictures outside the "list learning" 
context, and these seem deserving of mention relative to the work reported 
above. Basically, such studies offer leads on the degree to which words and 
pictures may arouse sufficienLly different responses to suggest caution in the 
instructional combining of particular verbal and pictorial representations. 
Deno, Johnson, and Jenkins (1968) investigated the similarity of associations 
evoked by pictures of objects and the verbal labels designating those objects. 
The purpose of the study was to gain some psychological purchase on the find- 
ing that word and pictoral stimuli may produce differential effects in tasks of 
Iprning and retention (e. g. , Deno, 1968; Jenkins, Neale, and Deno, 1967; 
Kale, Grosslight, and McIntyre, 1955), The authors found that in terms of 
associative meaning (Deese, 1962), "a picture does not represent the same 
concept as a word" even though the two are nominally in correspondence 
(i. e, , the word "apple" and a picture of an apple, etc. ). Similar findings 
iiave been obtained by Bourisseau, Davis, and Yamamoto (1965) and Anderson 
(i966) in terms of such logical dimensions as "sense" impressions and bi- 
polarity ratings in which responses to word and picture stimuli were scored. 
The same problem has been investigated from a quite different perspective by 
Shepard and Chipman (1970), who were attempting to tie down the concept of 
'internal representation" for pictorial and verbal stimulus events. The S's 
task V g to give judgments of rated similarity for the shapes of fifteen sfates, 
based upon (a) only the state rianies, or (b) the visual state outline without the 
name. While Conrad (1964) found stimulus similarity (and hence confusion 
errors in short-term memory) to be based upon the acoustic rather than the 
visual properties of the stimuli, suggesting that the internal representation 
of visually presented letters was at least initially related to the names of the 
letters, " Shepard and Chipman found just the reverse. Namely, Ss appear to 
rate similarities among shapes cued by names much as they do when presented 
with the actual visual outlines. This type of inquiry seems fairly basic to an 
understanding of some of the processes underlying imagery for verbal cues, 
and the authors comment that such efforts are really in their infancy. 

Effect of Pictures on Comprehension -- The literature regarding the 
effects of pictures on text comprehensions is in principle fairly closely 
related to the experimental manipulations performed during the current 
project. However_ such work does not offer the attractive theoretical base 

as does that of imagery (though hindsight again suggests the role which 

imagery may play in some of the comprehension studies). A serious problem 
for valid generalization Is that much of the instructional research on pictorial 
aids to comprehension has been performed with children rather than adults 
With these cautions in mind, two reports in this area must be noted. Koehnke 
(1968) studied ability to identify the main idea of a paragraph of prose 
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material with content-relevant pictures as the independent variable The Ss 
were third and sixth graders and four treatments were evaluated, as follows- 
(1) text only; (2) text plus pictures, but no instructions to use the accompanv- 
ing picturesi (3) text plus pictures, minimal directions on pictures use* 

(4) text plus pictures, "maximum" directions to use the pictures, Koehnke 
found that pictures did not add to Ss’ ability to state the main ideas of the 

paragraphs, even with maximum directions as to the use of the pictoria' 
material. 

Structured Presentation Modes Bower (1970) provides an excellent 
review of research on grouping and relating of to-be-learned verbal materials. 
Three points clearly applicable to the present studies are discussed below 
First, Bower describes a wide range of variables which may influence the 
extent to which Ss more effectively organize and learn verbal materials of 
which I is but one of many potentially influential factors in recall. Second 
Bower reaffirms the importance of distinguishing between E and S codes In 
verbal learning, with special emphasis upon E's discovering and making effec- 
tive uce of the latter in the design of the material presentation. (Note also in 
this context such diverse applications of S codes as those described by Tulving 
1968, Boltwood and Blick, 1970; Montague, Adams, and x^iess, 1966; and 
Montague and Wearing, 1967). In the present context, the pictorial stimuli 
used must be classified, at least for the time being, as £ codes. Hence, we 
do not know their relevant stimulus properties as processed bv S. Instead 
the pictures represented the investigators rendition of an effective I stimulus 
related to the critical instructional material. Were the studies to be redone 
It might well be desirable to generate the pictorial aids on the basis of S's 

escriptions of the images aroused by the actual spoken and written instruc- 
tional text. 

Finally, Bower describes several experiments concerned with the role of 
natural conceptual hierarchies in learning and retention of large sets of words. 
In one experiment, 2 8 to-be-learned words were ordered into a natural con- 
hierarchy constructed from a structural rule. In the control condition 
the 2 8 words were presented in a random manner. Differences in recall 
favoring the structural- rule organization were striking; more words were 
recalled on the first trial for the "organized" condition than on the last trial 
by the Ss receiving randomly structured materials. This effect may be 
mediated by visualization processes, but it seems premature and possibly 
inaccurate to invoke imagery itself as a determinant factor. Instead, the 
experiments demonstrate the considerable value of careful and systematic 
organization of verbal materials according to conceptual rules. In the present 
context, the requisite verbal recall may have been facilitated by its own struc- 
t^ural organization in the absence of any overt pictorial representation. Ihis 
^y^thesis is subject to test in research designed to deliberately manipulate 
both the textual and pictorial properties of the instructional material and should 
have high priority in future LRT instructional research. 

Sir aul^ion -- Gagne (1962) provides an excellent overview of 
simulators in term.i of instruction and on-line training objectives, Campbell 
(in press), in an Annual Review chapter devoted to Personnel Training and 
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Development, finds relatively few studies explicitly concerned with fidelity of 
simulation (where he expected to find many). A good many service supported 
studies of flight simulation have been carried out (e. g. , Ellis, Lowes, 

Matheny, and Norman, 1968j Demaree, Norman, and Math eny, 1965)' but 
appear outside the specific criterion-task cbncerna of the present research. 

In a study of radar training requirements. Silver, Jones, and Landis 
(1965) give some empirical support to the idea that paper and pencil sirr-ula- 
tion devices (as used in the present studies) may successfully be employed 
for highly skilled operators (though not for task- naive ones). Research on 
individual differences in perceptual-motor skills (e. g. , Fleishman, 1967) has 
consistently demonstrated that the ability requirements of a task may change 
over periods of practice. The question then arises^ what com.ponents of the 
task, and at what level of task proficiency, should be simulated? The present 
research was concerned primarily vnth task simulation for the relatively early 
stages of practice. Clear answers regarding effects of degrading fidelity of 
simulation at initial levels of task proficiency are somewhat inconsistent, 
and made more so by potential retention X fidelity interactions, as reported 
by Grimsley (1969) for guided missile trainees, and by Hammerton and Tickner 
(1967) for Ss learning remote- control operations. Briggs and Naylor (1965) 
varied degree of task organization and fidelity of the training task (a real radar 
scope versus a cardboard cutout), and found team training not to transfer well 
when the training simulation was of low fidelity. Briggs and Johnson (1966) 
subsequently found stimulus fidelity more important than response fidelity in 
this situation (a finding with some interesting ties to the earlier description 
of I effects given above). 

While the studies described in this report show that E has considerable 
latitude In permissible variations of the display representation, training on a 
paper mock-up is not identical to similar training on the CCC (note Figures 16 
and 17). However, as Gagne (1962) points out, fidelity or degree of simula- 
tion may meaningfully refer to the specification of tasks to be performed by S 
during training, rather than to the formal resemblance of training and criterion 
equipment. 

Simulation may not only involve the systematic training of certain task 
components while other situational variables are deliberately excluded* but 
may also involve, for example, variations of operational stimulus materials. 
The criterion task used in the present studies (the CCC) allowed the simula- 
tion of training mode features, but did not involve stimulus materials (mes- 
sages) ideritical to those encountered in typical Naval tasks. Most simply, 
there are many shades of meaning ascribed in the use of the term simulation, 
only one of which has yet been systematically explored in this report. 
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SECTION VI 

TECHNICAL APPROACH - RETENTION EFFECTS 



A major problem with research investigating learning, retention and 
transfer is the size required of experiments in which all three processes are 
studied. Any single L, R &• T experiment is automaticallj’ a three-factor 
investigation. Various classes of variables are associated with learning, 
retention, and transfer. For example, imagery was treated as a variable 
associated with learning, and fidelity of simulation has been considered a 
transfer variable. 



The most obvious variable, relating to retention, is the time elapsing 
between training and transfer sessions. We have not manipulated this 
variable within any one experiment for two basic reasons. First, retention 
interval, at least in the present context, can be studied only as a between- 
group variable. Thus, the size of an experiment is multiplied by the number 
of retention Intervals studied. Second, retention was not considered a high 
priority variable by participants at the L, R & T technical meetings -- 
probably because forgetting curves have been obtained frequently in the past 
and look similar regardless of the conditions under which they have been 
obtained. Unless one is interested in the retention characteristics of a 
particular task, it is usually sufficient to know that the forgetting curve will 
be a monotonic, decreasing function of time. 

Retention data are available in the present program by examining the 
retention interval across experiments. Because a control group 'high fidelity 
no imagery) was run in each of the first three experiments, assessment of 
retention interval effects is possible. 

Figures 18 and 19 show these data, expressed in percent savings scores. 
Experiment I provided the one-day values. Experiment II the seven-day 
interval, and Experiment III gave the 14-day scores. Each group contains 
two curves. One is for savings between block 1 of the training session and 
block 1 of the transfer session. The other curve shows savings averaged 
across blocks of trials. One graph (Figure 18) shows savings scores based 
upon time data, and the other (Figure 19) shows savings data based upon 
accuracy scores. 



Time 



Acq. 



- Time 



Time 



Transfer 



■ 

Acq. 



X 100 



For the data in Figure 19, savings was calculated as 

F 

Savings = - 



Percent Errors. - Percent Errors™ - 
Acq, Transfer 

Percent Errors 



Acq. 



X 100 



Figure 1 



Figure 19 
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OVERALL SAVINGS VERSUS FIRST TRIAL SAVINGS 

Figures 18 and 19 both show that savings tend to be higher on initial 
trials than on later trials. This difference is greater for accuracy data 
than for time data. Further, something akin to a reminiscence effect is 
obtained on the initial trials for the accuracy data. Tl.at is, accuracy on 
the initial trials is somewhat better after a seven day retention interval 
than after only a one day interval. Otherwise, the ciassical retention effect 
is noted, viz, retention decreases as the interval increases. In both cases, 
it is significant to note that there are no savings (or worse) with a 14" day 
retention interval. 

These data have basic implications for training procedural tasks In the 
Navy. It appears that if transfer takes place after more than about a week, 
training effectiveness might be seriously impaired. Moreover, if the opera- 
tional task does not provide immediate knowledge of results, errors will tend 
to perseverate. Thus, in summary, the effects of a retention interval on 
system effectiveness, under conditions where immediate knowledge of results 
is not available to the performer, would appear to be a differential function of 
two factors: (1) the criticality of response speed versus response accuracy 
to successful performance on the task, and (2) the duration of the retention 
interval. The present data suggest that the most deleterious effects on 
retention are manifested on response accuracy after a 14-day retention 
interval (where performance was degraded close to 35 percent). On the other 
hand, all other combinations of retention interval and performance measure 
result in at least as good performance after the retention interval as in the 
Initial learning session. Thus, if system effectiveness depends on accuracy 
of performance, then retention intervals longer than seven days might lead 
to significant performance decrements. 
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SECTION VII 

SUMMAKY AND RECOMMENDATIONS 



Phas3 II of the L, R, and T program involved four studies. Three of 
these were laboratory Investigations and the fourth was a survey of expert 
opinion, followed by the synthesis of an approach to studying task difficulty. 
An evaluation of these activities must be made from the point of view of 
setting the stage for a long-term experimental program on L, R, and T at 
NAVTRADEVCEN. 

The five experiments conducted during these two initial years of the 
program concerned themselves solely with the learning, retention, and 
transfer of a procedural skill. Procedural skills were chosen because they 
are involved in Naval jobs of all descriptions. It is evident that we have 
only scratched the surface of knowledge about this category of behavior. 

While it appears that verbal learning and verbal behavior underlie many 
aspects of procedural skills, one cannot account for or predict behavior in 
tha training and transfer of procedural skills, by solely appealing to the list- 
learning literature. Earlier in this report, a discussion of some of the 
similarities and differences between procedural and verbal learning was 
presented. Significantly more research is required in this area before the 
design of more effective training systems can be accorr^plished in a scientific 
manner. 

Four variables have been investigated in these five experiments. One of 
these (imagery) is a possible technique for improving trainees' understanding 
of basic system structure, and is thus a varialjle primarily associated with 
learning. This is not to say, however, that the effects of imagery in training 
may not be present in retention and transfer. A second variable (fidelity of 
simulation) refers to similarities and differences between the training and 
transfer task. Fidelity of simulation can be considered a basic variable 
relating to transfer. The third variable (retention interval) relates to both 
learning and transfer in that it influences the extent to which skills acquired 
in learning sessions are manifested in operational situations. A fourth 
variable investigated in this series of experiments (individual difference.s) is 
related to learning, retention, and transfer by virtue of the fact that the 
innuence of variables associated with all three of these factors are bound up 
with characteristics of the learner. 

IMAGERY 

The finding of Phase I, regarding Imagery, seemed very promising. 
Experiment II suggested that the presentation of imagery during training tends 
to facilitate comprehension of the task. Evidence of this was based on a dif- 
ference In response latency which favored the imagery group. 

G6 
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Experiments III and IV clearly failed to support the initial findings. In 
both of these studies^ the imagery condition was associated with approximately 
the same performance levels as were obtained in Experiment II. However 
the control groups of the later investigations performed significantly better 
than the control group of Experiment II. 

Imagery has been employed experimentally in verbal learning studies 
(e. g. Senter and Hauder 196 8,- Paivio, 1969) to Improve acquisition and 
retention. The findings of such experiments have been very promising. 
Therefor Cj it would appear reasonable not to completely dismiss imagery 
in the procedural skills context. 

Several hypotheses about the conditions under which Imagery may be 
effective should be, considered further. The first notion regards a possible 
Interaction betweeh the effectiveness of imagery and the abilities of proce- 
dural task trainee^. This hypothesis was tested in Experiment IV, but due 
to theTack of spread in the distribution of verbal abilities scores, the data 
are inconclusive. A similar investigation should be conducted with a wider 
range of verbal abilities, and possibly, with a battery of tests to find which 
predict performance on the experimental task given various training 
methods. 

The second hypothesis to explain the inconsistency in findings, regarding 
imagery, was suggested earlier (see Experiments III and IV). That is, the 
effectiveness of imagery may interact with the degree of ccmprehension of 
the operating instructions. Thus, if subjects understand the task fully with- 
out imagery, the introduction of imagery sequences may add little to per- 

this hypothesis would require an experiment In v/hlch 
the goodness of instruction was varied under conditions of Imagery - no 
imagery. 

Finally, the particular way in which imagery was designed may not be 
optimal. The cartoon sequences involved only about seven minutes of a 90- 
minute instructional period. Possibly this presentation was not sufficient to 
provide a significant effect. Alternate ways of providing imagery to trainees 
to make the task more complete should be considered. 



FIDELITY OF SIMULATION 

The manipulation of levels of similarity in stimulus and response com- 
ponents between the training and transfer task produced results with impor- 
tant implications to the design of training systems. 

Experiments II and V provided data consistent with the notion that transfer 
depends more on similarity of basic system structure than on stimulus and re- 
sponse similarity. These resulLS were predicted onthe basis of Wittrock's 
(1968) idea of mediated generalization being the basis of transfer. In the 
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present task, subjects recognized that the operational task was not essentially 
different from the training task and were thus able to reconcile specific dif- 
ferences. Their ability to reconcile differences is very much the same as 
what psychologists mean by generalization; that is, one stimulus (or re- 
sponse) tending to become equivalent to an earlier stimulus (or response). 

The ability to achieve satisfactory training effectiveness under conditions 
of low fidelity can mean considerable cost savings to the Navy. It does not 
appear to be necessary to tacitly assume that training devices must be ”car- 
bon copies" of their operational counterparts. Instead, designers need to 
analyze the critical task features of the criterion system to determine how 
these should be represented in training. If it can reasonably be determined 
that trainees can recognize correspondences between training and transfer 
tasks with less than perfect fidelity, considerable cost savings may be possi- 
ble. 

This research by no means allows one to set specifications for fidelity 
levrels. Our findings do suggest, however, that trainees maybe able to 
tolerate rather high degrees of dissimilarity. Further research is needed 
to determine just how far one may go with this principle. 



TASK DIFFICULTY 

The decision to survey opinion regarding factors associated with the 
production of task difficulty was based on the fact that this variable is of 
central importance in the L, Rand T program. As a result of the analysis 
of the problem, it became obvious that task difficul+y is not a unitary variable. 
Four factors associated with variations in difficulty were identified. 

An approach to manipulating these factors was outlined earlier in this 
report. Basically, we recommend adjustin| levels of these factors according 
to constraints imposed under operational circumstances. For example, if 
performance of a system has been demonstrated to be unsatisfactory, an 
analysis of specific reasons for low human performance levels would be re- 
quired, Improved effectiveness might be achieved by any of the following 
techniques: j s 

• Improved training methods 

• Higher initis.l skill levels of operational personnel 

• Redesign of the task; e. g. , greater automation 

• Reduced criteria for adequate system performance 

Adjustment of all of these factors is not always possible. In situations 
where one or more of the factors are unalterable, experiments would Involve 
manipulation of the other(s). Such an investigation might involve various 
methods of simplifying the task or attempting different methods of- training. 

In any case, the nature of the experiment would be dictated by circumstances 
surrounding the Naval job In question. 
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The four studies described In this report directly, follow the planning and 
research of the first phase of L, R, and T. It must be recognized that the 
work accomplished in this two-year effort can be only the beginning of a much 
larger research prograi . 

The research accomplished thus far has dealt with only one category of 
behavior. Many of the variables studied are relevant to other taxonomic 
categories as well. For example, the retention findings for procedural skills 
may be different for pattern recognition or decision-making skills. 

An attempt at deriv. g a priority list of variables was undertaken in 
Phase I. P’orr of these variables were studied in the first two years, viz, 
imagery, fidelity of simulation, retention Interval, and individual differences. 
The findings associated with fidelity of simulation appear to be the most con- 
clusive of the four. However, even here it is evident that much more research 
is required before application to the design of training systems can begin to 
pay off in terms of cost effectiveness. 

It is the opinion of the authors that a continuing need w 11 exist to con- 
tinually establish priorities for the research yet to be conducted. Because 
economic considerations limit the amount of research conducted, one must 
continually concentrate on those areas with the greatest promise. It seems 
safe to say that fidelity of simulation is an area which can be fruitfully inves- 
tigated. If a decision must be made about limiting research in any one direc- 
cion, it would appear that further studies of the relationship between cost 
effectiveness of training and the fidelity of that training would be most worth- 
while . 
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appendix a 

SUMMARY C>F INTERVIEW ON TASK DIFFICULTY 



Interviewea 
H. Ammerman 



G. Briggs 



G. Jeantheau 



R. Mackie 



Factors Affecting Difficu lty 

• Number of iecision options or branches in a 
procedure (i, e. , ti oubleshooting versus fixed 
procedure). 

• (See additional items under E. Miller) 

• Number of different things a person must do at 
any single time, 

• Within any single dimension, the amount and 
kind of processing required, 

• Task organization, i. e. , degree of nonindepen- 
dence with dimensions, 

• Relative geometry of units, 1. e. , the fact, rate 
and amount of change. 

• Physical environment as it influences sensors. 

• System load 

number of units to be dealt with 

communication and coordination require- 
ments 

• Operational mission 

threat, urgency 

• Contingencies, emergencies, malfunctions. 

0 Signal to noise ratio 

• Multiple stimuli representing same object 

• Equipment alignment 

• Environment 
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T. Mara 



G, Matheny 



E. Miller 



L. Schrenk 



® Level of ambiguity 
9 Amount of information available 

• Amount of mental storage available 

• Overloading 

time stress 

speed and accuracy requirements 
© Psychological stress 

• Adapt^Aion requirements, i. e. , adapting to a 
variety of situations and environmental conditions 

• Procedural memory (time from interactions to 
actual performance) 

• Time stress (speed requirements) 

• Visual acuity (in raw video displa^rs) 

• Task distractor stress (uoing two things at once) 

• Environmental distractors (danger, noise, fear) 

• Intersystem coordination (timing and phasing) 

• Concept complexity (coordination and under- 
standing what others are doing with your job) 

• General complexity (length of process) 

• Physical strength stress 

• Number of information input channels used 

• Rate of information input 

• Uncertainty or unpredictability of input task 

• Complexity of rules for information processing 

• Complexity - amount of memory required 
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A. Siegel 



B. Yaeger 



En.viroiiiiierit&l fsictors *• nuinber of target 
target speed, etc. 

Crew integration requirements 

Intellectual loading 

Stimulus difficulty discrimination 

Cognitive difficulty 

procedure complexity 
procedure selection 

Response difficulty 

timing 



rhythm 
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APPENDIX B 

DIRECT IMAGERY (L. R, AND T) 




First, there is a map of Western Europe, parts of the Mediterranean, and 
the Atlantic Ocean. It shows the countries which speak the five languages 
included in this study: English, German, Spanish, Greek and Swedish. 
Also evident are some ships and aircraft which communicate in these 
languages. The land-based stations, the airborne ones, and those on ship- 
board have one, two, or three types of antennae -= of the three types of 
antennae, each emits its own unique type of signal. 
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The S-S routine can be deacrlbed in 3 steps: 

First, Sven Peterson, the operator of a Swedish Arctic outpost has a mes- 

corrimunication facility in the Swedish 
port of Holmstad. Peterson, the sender, flashes his communication request 
to the Communications Control Console. 
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In the senond scene, Peterson's request is received by the Control Console 
Operator. The Operator quickly determines that both Peterson and Olstad, 
the intended receiver, speak Swedish, and that both operate HP radio equip- 
ment. So, the console Operator relays the message directly from Peterson 
to Olstad on an available HP channel. 
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Finally, the connection between Peterson and Olstad is made, 
in direct communication with one another, with the radio sifn 
amplified through the Communication Control Console. 
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The S-T-S routine can be described in the following 4 scenes: 

fn =°“municate with Tully Spyropolous, 

in Greece. The Commuracation Control Console Operator receives the 
message request from Swenson. i-^ives me 

The Console Operator checks the language and frequency capabilities of the 

Swedish^a^s Receiver. He ascertains that Swenson speaks 

Swedish and has HF equipment. Spyropolous, on the other hand, speaks 

equipment. The Console Operator, there- 

Translator° “’® message STS, through the Language and Frequencj 
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In the nerf scene, the Control Console Operator brings the messaffe from 
Swenson into the console, on HF frequency. The messap-e ia T 

matically into the Language and Prequency Translator. au < 
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Nsxtj ths Optrator rsdirects the niessage to the Receiver’, Spyropolous 
on an open VHP channel. 
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Finally, at this point, Swenson, with HF equipment, and Spyropoloua, with 
VHF equipment, are comr- uni eating freely with one another through the 
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INTERRUPT 




Next we have the INTERRUPT ROUTINE, first for Interrupt -Standby. 

This situation shows General Nelson, who has an extremely important 
message for Colonel Maxwell who is aboard an aircraft. The Console 
Operator sees that the only communication channel usable by the Senior 
Officers is currently being used by two lieutenants conveying a fairly 
important message. 

Because of the urgent nature of the aeneraPs call, the Console Operator 
decides that he must interrupt the lieutenants. 
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In the next scene, the Console Operator flashes the standby signal to the 
lieutenants. The lieutenants, upon receiving the standby signal, temporarily 
discontinue their communication. * t* y 



The channel is thus freed and the Operator uses it to complete the 
between General Nelson and Colonel Maxwell. 



patch 
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INTERRUPT 




Next, we have INTERRUPT - BUSY 

The next time General Nelson had an important communique for Colonel 
Maxwell, the available channel is being used by two PPCs conveying routine 
information. 

The Console Operator flashes a BUSY signal to the PPCs indicating that they 
are to be cut off. 

Therefore, the PPCs will have to re-initiate their communication later. 
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Next is DENY - STANDBY 



Captain Breckenridge, piloting a KC-135 
deliver to the USS Hoover, which is with 



• has a very important message to 
the 7th fleet, off Gibraltar. 



The Console Operator notes that the only channei the ship can -eceive mes- 
currently being used by two senior officers whose communication 

IS just as important as that of Captain Breckenridge. munication 



88 




70 



NAVTRADEVCEN 69-C‘0253-l 




Therefore, the next step would be for the Console Operator to deny Captain 
Breckenridge's request to communicate. 

Because Captain B‘"'’ckenridge had a high priority request, he is placed on 
STANDBY. 
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The last situation is DENY - BUSY 



, Conklin, off duty, on the Riviera, remembers a few details 

h^e wants his aide, aboard a small service boat, to clear up for him. The 

=^®'5«®sts a patch between himself and hls^ide 
^rSSyfn use'by ofherpVrtfe^"^ communication channels are 
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a busy I® priority, the operator Hashes 

a busy signal and he will have to re-request a patch at some other time. 
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iiufa report summarizes Phase I and reports on Phase II of the L, R, and T prosram 
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^ exploration of the influence of ima^rfa^^^^ 

fidelity of simulation on learning, retention, and transfer. A sum^ey of eJnert onlr^on 

thTon^-lear ‘effort!'"”^ investigations were condS:ted during 



The specific purpose of the Task Difficulty Survey was to define those factors which 
influence task difficulty in the operational Navy setting. Once identified 
these factors can be used to realistically manipulate the difficulty of tasks in labora-' 
ory investi^gations. Telephone interviews were conducted with 10 scientists repre- 
ss both military and civilian research organizations, to obt^/Sel^rlllnL. 

The results of this survey were inconclusive. Further, a majority of the difficultv 
■factors mentioned by interviewees were the same ones whioh ha i ^ 

aonr^n^ laboratory. Consequently, the problem became one of sugg^Jting^an 

manipulating such variables. An overall plan is suggested flgufde 
ubsequent investigations in which task difficulty is either controffed or maaputed. 
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Experiment III addressed two questions: 
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-L. • 



What is the relative training effectiveness of two forms of imagery; i.e. , 
(a) when new material is related to more familiar material in an analogous 
fashion and (b) when new material is represented directly? 

■^Arhat are the relative contributions of Images and text In the presenta- 
tion of imagery? 

This experiment was designed to validate the facilitating influence of imagery found 
in Experiment II of the series. The findings of Experiment III failed to support the 
facilitation found in Experiment II. These results are discussed in light of the sub- 
ject samples and experimentarvp^ocedures used. 

Experiment IV was similar to III, with the exception that subjects were trained with 
a paper and pencil rather than a hardware simulation of the task. The purposes of 
this study were to resolve discrepancies in the results between Experiments II and 
III, and to test the hypothesis that the effectiveness of imagery interacts with verbal 
skills. The findings were consistent with Experiment III providing no evidence that 
imagery Improves performance. This finding was consistent regardless of verbal 
skill level. The hypothesis that imagery should be more effective for subjects with 
lower verbal skills was thus not supported. Those results are discussed in relation 
to the restricted range of verbal skills of the subjects used. 

Experiment V investigated the influence of training task fidelity of simulation on 
transfer performance. Subjects were trained using one of three levels of fidelity. 
The data Indicated that variations' in stimulus and response fidelity had little effect 
on response time or accuracy, The^data are interpreted as supporting the findings 
of Experiment II; 1, e. , that relatively high levels of training effectiveness can be 
obtained for procedural tasks in the absence of high physical fidelity between 
training and transfer task%. 



In a final section the work on this program is summa 
made for the direction of future research. 
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Investigations into the role of imagery and fidelity 
of simulation on learning retention and transfer 
were conducled. These experiments were part of 
a long range program leading to improved training 
methods for the Na^^^ Imagery did not have a 
eonsiatently beneficial effect on transfer perfor- 
mance. Relatively high levels of training effec- 
liveness roaulted for procedural tasks in the 
absence of iiigh physical fidelity between training 
and transfer conditions. 
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Investigations into the role of imagery and fidelity 
of simulation on learning retention and transfer 
were conducted. These experiments were part of 
a long range program leading to improved training 
methods for the Navy, Imagery did not have a 
cofiststently beneficial effect on transfer perfor- 
mance. Relatively high levels of training effec- 
livencss resulted for procedural tasks in the 
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and t.'ransfer conditions. 
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Investigations into the role of imagery and fidelity 
of simulation on learning retention and transfer 
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